Frontier AI Evaluation Engineer: Build Next-Gen Benchmarks
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
En continuant, vous acceptez nos Conditions d’utilisation & Politique de confidentialité.
Mistral Ai is seeking an Evaluation Engineer to own evals from start to finish, running workshops with customers and industry experts to identify the most impactful use cases. You will design benchmarks, source data, score outcomes, and run evaluations across new Mistral models and competitors.
You will collaborate with post-training teams to tighten gaps, increase challenge, and present findings to senior leaders for strategic decisions.
-
Paris, Nouvelle-Aquitaine, France Wwshemi Temps plein 70 000 € - 110 000 € ContratMistral is building frontier LLM evals to shape the next generation of flagship models. As an Evaluation Engineer, you will own evals from start to finish, running workshops with customers and internal teams to identify critical industry use cases and design benchmarks to measure them inside real software.You will source data, define scoring, and run...
-
Senior Backend Engineer
Il y a 3 jours
Paris, Nouvelle-Aquitaine, France H Company Temps plein 70 000 € - 110 000 € ContratAbout H:When we released Holo4 on 28 September, we published every trajectory behind its public benchmark scores at trajectories.hcompany.ai. For OSWorld that's 369 desktop tasks, each run 3 times, with the steps, tokens and time of every attempt. This role builds and runs the evaluation framework that produces runs like these.H builds computer-use agents...
-
Evaluation Engineer, Applied AI
Il y a 16 heures
Paris, Nouvelle-Aquitaine, France Mistral Temps plein 70 000 € - 110 000 € ContratОписание:Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms. We...
-
Evaluation Engineer, Applied AI
Il y a 16 heures
Paris, Nouvelle-Aquitaine, France Mistral Ai Temps plein 90 000 € - 130 000 € ContratAbout Mistral Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms. We are...
-
AI Evaluation Platform Research Engineer
Il y a 3 jours
Paris, Nouvelle-Aquitaine, France Mistral Temps plein 90 000 € - 130 000 € ContratAbout MistralMistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.We are a...
-
Evaluation Engineer, Applied AI
Il y a 5 jours
Paris, Nouvelle-Aquitaine, France Wwshemi Temps plein 70 000 € - 110 000 € ContratAbout Mistral Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms. We are...
-
Head of AI Lab
Il y a 4 jours
Paris, Nouvelle-Aquitaine, France Criteo Temps plein 200 000 € - 320 000 € ContratWhat You'll Do:Shape the Future of AI in CommerceCriteo is looking for an exceptional AI leader to head the Criteo AI Lab (CAIL) and define the next generation of AI innovation for one of the world's largest commerce media platforms.This is a unique opportunity to lead a world-class organization of over 70 AI researchers and engineers, while providing...
-
Generative AI Engineer: Build Scalable GenAI Apps
Il y a 2 jours
Paris, Nouvelle-Aquitaine, France Sia Partners Temps plein 60 000 € - 80 000 € ContratSia is a next-generation, global management consulting group. Founded in 1999, we were born digital. Today our strategy and management capabilities are augmented by data science, enhanced by creativity and driven by responsibility. We’re optimists for change and we help clients initiate, navigate and benefit from transformation. We believe optimism is a...
-
Agent Builder
Il y a 16 heures
Paris, Nouvelle-Aquitaine, France Mirakl---Labs Temps plein 65 000 € - 85 000 € ContratFounded in 2012, Mirakl has been at the forefront of marketplace innovation, empowering every business to compete in the platform economy.Today, Mirakl’s operating system combines an enterprise marketplace solution (Mirakl Platform) that enables retailers and B2B organizations to launch, scale, and operate marketplaces and dropship, AI-powered multichannel...
-
Agent Builder
Il y a 3 jours
Paris, Nouvelle-Aquitaine, France Mirakl Temps plein 55 000 € - 65 000 € ContratFounded in 2012, Mirakl has been at the forefront of marketplace innovation, empowering every business to compete in the platform economy. Today, Mirakl’s operating system combines an enterprise marketplace solution (Mirakl Platform) that enables retailers and B2B organizations to launch, scale, and operate marketplaces and dropship, AI-powered...