Emplois de ai evaluation engineer – Paris

About MistralAt Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed...

Mistral is seeking an Evaluation Engineer in Paris to design and implement evaluation systems for enterprise AI models. You will work at the crossroads of research, engineering, and customer-facing teams, measuring model performance across diverse use cases and contributing to production-ready evaluation frameworks.You will design scalable pipelines, develop...

Braintrust is seeking experienced software engineers for a contracting engagement to build and evaluate cutting-edge LLMs. Based in Paris or London, with Europe remote possible for strong candidates, the role sits at the intersection of real-world software engineering, model evaluation, and applied AI.You'll design coding prompts, evaluate model outputs,...

This is a contracting engagement - initially 6 months - with potential for long term engagement.Location: Paris or London-based preferred; alternatively Europe remote for strong candidatesWe are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation team....

White Circle is seeking a research engineer to build and maintain an internal benchmark suite for single- and multi-turn content and agentic safety. You’ll work with the team on projects studying agent behaviours in the wild and help evolve evals for new features and data.The role involves Python development, production-grade benchmarks, and collaboration...

Mistral.ai is seeking an AI quality engineer embedded in a product team to advance AI features across search, chat, documents, and audio. You will define what good looks like, measure it, run experiments, and ship improvements that affect quality, latency, safety, and reliability.You will design evaluations, track key metrics, own prompts and system prompts,...

White Circle is hiring a research engineer to own and maintain our internal benchmark suite for single and multi-turn content guardrails and agentic safety. You will work with the product team to ensure evals cover core functionality of flagship models and to adapt benchmarks to new features and data.You will also study realistic agent behaviours in the wild...

Copy of CFD & Aerodynamic Engineer (AI Training & Evaluation) An enterprise client is seeking CFD & Aerodynamic Engineers to help train and evaluate next-generation AI systems by contributing real-world engineering expertise. This opportunity is offered by a leading AI data platform that enables organizations to build intelligent applications powered by...

Datadog is seeking an Engineering Manager for the Evaluation & Annotation team in a hybrid, France-based role. You will lead 4–6 engineers and shape the technical roadmap in collaboration with AI platform and Applied AI teams.You’ll drive tooling, datasets, and processes for scalable model evaluation and human-annotation workflows. You are a software...

SaferAI is seeking a Research Engineer or Research Scientist to join the Evaluations team in Paris, with opportunities to influence risk management across frontier AI labs. You will develop threat models, run evaluations, and deliver rigorous reports while advancing safety practices with international partners.A fast-growing environment, competitive...

Datakeen recherche un AI Evals Engineer pour garantir la fiabilité des modèles et accélérer l’itération des équipes. Vous développerez des pipelines Python robustes et des cadres d’évaluation pour des modèles Deep Learning et des agents.Vous collaborerez avec les équipes produit et dev pour transformer les besoins métiers en critères...

Overview The AI platform is responsible for all AI infrastructure across Datadog. Our mission is to provide tools and platforms that enable data scientists and engineers to conduct large‑scale training and inference with ease. We support products such as Bits AI, LLMObs and all of our AI research. As an engineering manager for the Evaluation & Annotation...

The AI platform is responsible for all AI infrastructure across Datadog. Our mission is to provide tools and platforms that enable data scientists and engineers to conduct large-scale training and inference with ease. We support products such as Bits AI, LLMObs and all our AI research.As an engineering manager for the Evaluation & Annotation team, you’ll...

About the RoleWe are looking for an AI Engineer acting as a full-time subcontractor/freelancer to design and scale intelligent workflows in close collaboration with our internal team. Our product is a cybersecurity SaaS platform that helps manufacturers and security teams certify IoT and connected devices against international regulatory standards. It is...

À propos du rôle Au sein de la practice AI & Data, nous recherchons un(e) AI Engineer / Agentic AI Engineer – Consultant pour piloter la conception et la mise en œuvre de solutions avancées en Intelligence Artificielle, Machine Learning, IA Générative et IA Agentique pour des clients grands comptes. Dans ce rôle, vous serez responsable de certains...

About Blue Yonder Blue Yonder is the AI company for supply chain. Our platform helps the world's leading companies plan, fulfill, deliver, and operate more resilient supply chains across complex global networks. About Blue Yonder Blue Yonder is the AI company for supply chain. Our platform helps the world's leading companies plan, fulfill, deliver, and...

About the Role We are looking for an AI Engineer to help build Blue Yonder's next generation of AI-powered products. As part of Blue Yonder's Autonomy Labs, you will work with experienced software engineers, model-training teams, data engineers, researchers, and product owners to develop agents that operate within real supply chain and retail workflows. You...

Blue Yonder is seeking a deeply technical Director of Model Behavior & Evaluation Systems to own the behavioral quality system for its LLM agents. This leader will define what good behavior means, establish release gates, and build feedback loops from traces, SME review, telemetry, and eval failures into model improvements.The role demands systems thinking,...

Descriptif du poste eXalt Value accompagne ses clients dans la valorisation de leurs données et l’industrialisation de solutions innovantes à fort impact. Dans le cadre du développement de nos activités Data & IA, nous recherchons un(e) AI Engineer pour concevoir, déployer et maintenir des solutions d’intelligence artificielle en environnement de...

Datadog is looking for an engineering manager to join the Evaluation & Annotation team in Paris. In this role, you'll manage 4-6 engineers, defining the technical vision and roadmap for AI infrastructure.Your responsibilities include growing the team culture aligned with engineering standards, participating in hands-on coding, and collaborating with core...