Data Scientist

Gorgias empowers ecommerce brands to grow through AI-powered customer experience. We are the #1 CX platform in the industry, trusted by over 15,000 merchants worldwide - from small independent shops to some of the largest ecommerce brands in the world.

We offer the most integrations of any tool on Shopify (100+) and the ability to get setup fast, without the need for complex onboarding. Gorgias offers its users a unified platform to manage every aspect of their customer support on every channel.

We can automate 60% of a brand’s support so that agents can focus on high-value conversations and driving sales. Plus, we offer purpose-built marketing tools to help merchants convert more shoppers into customers, driving GMV.

**Join our team for the opportunity to**:
Work with smart, passionate people every day

Get extreme ownership over your work and results

Be treated like the expert you are

**Engineering Team Culture**:
Getting Stuff Done, Ownership, Team Work, Excellence, and Agility.

You should join us if you want to ship stuff fast without sacrificing quality. We've put great importance on testing our code, cleaning it, treating errors first, and features later.

We also value growth and ownership. People make mistakes. We learn from them to avoid them in the future. We cannot achieve excellence if there are no bumps in the road.

**About the Team**:
You'll be joining our dynamic Automate team, a cross-functional group dedicated to revolutionizing customer support in the ecommerce space. Our mission is to seamlessly automate interactions between merchants and shoppers, creating effortless experiences for both sides. The Automate team consists of talented Software Engineers, Machine Learning Engineers, Product Managers, and Designers, all working collaboratively to push the boundaries of AI-driven customer support. Our primary focus is developing and refining an innovative AI Agent capable of automatically answering customer requests with accuracy and efficiency.

**What you will do**:
**Role Overview**: As a Data Scientist focused on LLM at Gorgias, you will play a crucial role in developing, refining, and enabling our AI Agent, designed to automatically address and resolve shopper requests for our merchant clients. Beyond prompt engineering, you'll be instrumental in scaling the AI Agent's capabilities by developing the right LLM strategies to enable our services. You will work closely with our ML Engineers, Product Managers, and Software Engineers to create, optimize, and implement solutions that enhance the efficiency, accuracy, and functionality of our AI-driven customer support solutions.
- ** Key Responsibilities**:

- ** LLM pipelines**: Design, develop, and refine prompts to guide the AI Agent in generating accurate and contextually relevant responses to shopper inquiries. Identify patterns, and drive improvements in both prompt design and overall AI Agent performance.
- ** Data Analysis**: Analyze large-scale data from LLM evaluations to derive insights, Identify heuristics to sample improvement and non-regression dataset. Build reliable estimators for on-going AB tests, analyse optimal experiment stoping time and mitigate cross AB test contamination.
- ** Testing & Evaluation**: Conduct extensive testing of prompts to ensure they perform well in diverse scenarios. Design and implement robust methodologies for assessing LLM performance at scale. Evaluate prompts rationally via systematic testing protocols(off-line train/test splits, on-line with AB tests).
- ** Collaboration**: Work product managers to understand requirements, incorporate feedback into prompt design and improvement, and integrate findings from large-scale evaluations into the AI Agent's development. Work with ML engineers to build and fine-tune in-house LLMs that out-perform state of the art.
- ** Documentation**: Maintain comprehensive documentation for prompt design, usage, best practices, and evaluation methodologies to ensure clarity and consistency across the team.
- ** Continuous Improvement**: Stay up-to-date with advancements in AI, natural language processing (NLP), and prompt engineering techniques. Incorporate cutting-edge methodologies into prompt engineering and LLM evaluation processes.
- ** User Experience**: Analyze and interpret user interactions and large-scale performance data to identify areas for enhancement and ensure the AI Agent provides a seamless and positive experience for shoppers.
- ** Performance Metrics**: Develop and refine metrics for evaluating prompt and LLM performance at scale, ensuring that improvements can be quantifiably measured and validated.
- ** Technical Enablement**: Develop and scale connections between AI Agents and the e-commerce ecosystem, allowing the AI to perform a wide range of actions. Collaborate with Software Engineers to identify integration opportunities and implement scalable solutions that expand the AI Agent's capabilities across various platforms and tools used i