Ai Engineer, Product,

il y a 1 semaine

Paris, France Mistral AI Temps plein

**About Mistral**

At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.

We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise needs, whether on-premises or in cloud environments. Our offerings include le Chat, the AI assistant for life and work.

We are a dynamic, collaborative team passionate about AI and its potential to transform society.

Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.

**Role summary**

Embedded directly in Le Chat product Team, you will build the evaluation and A/B testing framework, add end-to-end observability, and run a reliable model release process. Work with Science to ship measurable improvements to quality, latency, safety, and reliability

**What you will do**
- Build and maintain an LLM evaluation framework (reference tests, heuristics, model-graded checks).
- Define and track metrics: task success, helpfulness, hallucination proxies, safety flags, latency/cost.
- Run A/B tests for prompts, models, and system prompts, analyze results, recommend rollout or rollback.
- Set up observability for LLM calls: structured logging, tracing, dashboards, alerts.
- Operate the model release: canary and shadow traffic, sign-offs, SLO-based rollback criteria, regression detection.
- Improve core behaviors: memory write/retrieve policies and evals, intent classification, follow-ups, routing, tool-call reliability.
- Create templates and docs so other teams can author evals and ship safely.
- Partner with Science, diagnose regressions and lead post-mortems.

**About you**
- Strong TypeScript or Python skills
- Production LLM experience: prompts, tool/function calling, and system prompts.
- Hands-on with evals and A/B testing, you can design metrics and make rollout decisions from data.
- Observability: logging, tracing, dashboards, alerting
- Product mindset: form hypotheses, run experiments, interpret results, iterate.
- Clear written and spoken communication, autonomous; and product-oriented.

Now it would be ideal if you have experience with
- Safety systems: moderation, PII handling/redaction, guardrails.
- Release operations: canary/shadowing, automated rollbacks, experiment platforms.

**Hiring Process**
- Introduction call - 45 min
- Hiring Manager interview - 30 min
- Technical Rounds
- Live-coding Interview (Machine Learning) - 45 min
- Live-coding Interview (Algorithm) - 45 min
- Culture-fit discussion - 30 min
- References

**Location & Remote**
- for the first month of their onboarding (accommodation and travelling covered)
- then at least 3 days per month

**What we offer**

Competitive salary and equity
- ️ Health insurance

Transportation allowance

Sport allowance

Meal vouchers

Private pension plan

Parental : Generous parental leave policy

Visa sponsorship

  • AI Engineer, Product

    il y a 1 semaine

    Paris, France Mistral AI Temps plein

    AI Engineer, Product at Mistral AI At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting‑edge models, products and solutions. Our comprehensive...

  • Applied AI Engineer, Fullstack Software Engineer

    il y a 21 heures

    Paris, Île-de-France Mistral AI Temps plein

    About MistralAt Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed...

  • AI Engineer, Product

    il y a 2 semaines

    Paris, Île-de-France Mistral AI Temps plein

    About Mistral  At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is...

  • Applied AI Engineer, Fullstack Software Engineer

    il y a 2 jours

    Paris, France Mistral AI Temps plein

    Join to apply for the Applied AI Engineer, Fullstack Software Engineer - EMEA role at Mistral AI Get AI-powered advice on this job and more exclusive features. About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working...

  • AI Engineer, Product

    il y a 2 semaines

    Paris, Île-de-France Mistral AI Temps plein

    About MistralAt Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to...

  • AI Engineer, Product

    il y a 2 semaines

    Paris, Île-de-France Mistral AI Temps plein

    About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed...

  • Product engineer

    il y a 6 jours

    Paris, Île-de-France Symbiotic Security Temps plein

    Product Engineer (Backend-leaning) – AI & Security Paris (Morning Laffitte) | 2 remote days/week | Full-timeAbout Symbiotic SecuritySymbiotic Security is a cybersecurity startup helping developers write secure code through an AI-powered assistant integrated into their IDE and CI/CD pipelines.Our product does two things extremely well:Detect & fix...

  • Software Engineer, Backend

    il y a 2 jours

    Paris, France Mistral AI Temps plein

    Join to apply for the Software Engineer, Backend role at Mistral AI Get AI-powered advice on this job and more exclusive features. About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through...

  • Applied AI, Forward Deployed Machine Learning Engineer

    il y a 2 jours

    Paris, France Mistral AI Temps plein

    Join to apply for the Applied AI Engineer, Use-case - EMEA role at Mistral AIContinue with Google Continue with GoogleJoin to apply for the Applied AI Engineer, Use-case - EMEA role at Mistral AIGet AI-powered advice on this job and more exclusive features.Sign in to access AI-powered advicesContinue with Google Continue with GoogleContinue with Google...

  • Software Engineer, Back-end

    il y a 2 jours

    Paris, France Mistral AI Temps plein

    Software Engineer, Product (Python) Join to apply for the Software Engineer, Product (Python) role at Mistral AI. About Mistral AI At Mistral AI, we believe in the power of AI to simplify tasks, save time and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through...