Emplois actuels liés à Principal Coding Annotator - Paris, Île-de-France - Braintrust

  • Stage Recherche

    il y a 1 semaine


    Paris, Île-de-France CAPITAL FUND MANAGEMENT Temps plein

    Date: 27 janv. 2026Lieu: Paris, 75, FREntreprise: Capital Fund ManagementÀ PROPOS DE CFMFondés en 1991, nous sommes une société mondiale de gestion d'actifs quantitative et systématique appliquant une approche scientifique à la finance pour développer des stratégies d'investissement alternatives pour nos clients.Nous valorisons l'innovation,...


  • Paris, Île-de-France MSD Temps plein

    Job DescriptionMission générale de la fonctionStage de découverte des missions d'un département affaires réglementaires au sein d'un site exploitant.Activités principalesAu sein du Siège de notre entreprise, vous rejoindrez la Direction des Affaires Réglementaires sous la supervision d'un responsable Affaires Règlementaires.En tant que stagiaire en...


  • Paris, Île-de-France MSD Temps plein

    Job DescriptionMission générale de la fonctionStage de découverte des missions d'un département affaires réglementaires au sein d'un site exploitant.Activités principalesAu sein du Siège de notre entreprise, vous rejoindrez la Direction des Affaires Réglementaires sous la supervision d'un responsable Affaires Règlementaires.En tant que stagiaire en...


  • Paris, France Braintrust Temps plein

    OverviewThis is a contracting engagement - initially 6 months - with potential for long term engagement.Location: Paris-based preferred; alternatively Europe remote for strong candidates.What You’ll DoCreate high-quality coding prompts and reference answers (benchmark-style, e.g. SWE-Bench-like problems).Evaluate LLM outputs for code generation,...

  • Senior Coding Annotator

    il y a 2 semaines


    Paris, France Braintrust Temps plein

    Job Description This is a contracting engagement - initially 6 months - with potential for long term engagement. Location: Paris-based preferred; alternatively Europe remote for strong candidates We are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and...

  • Principal Data Scientist

    il y a 7 jours


    Paris, France Talented International Temps plein

    About Us We are a start-up based in Munich, Madrid and in Barcelona. We were founded in Spring 2020 and two and a half years later we are now already a team of +80 super motivated ML Engineers, data scientists and developers. Our mission is to build beautiful Artificial Intelligence products. We’re curious, passionate, and relentless in our drive to...


  • Paris, France Ogury Temps plein

    Ogury is** a global adtech company** that delivers Personified Advertising solutions grounded in privacy to brands, agencies and publishers by focusing on targeting personas, not people. - We deliver relevant audiences at scale and on quality publisher inventory thanks to **our exclusive data**, which is meticulously collected and crafted from millions of**...


  • Paris, France Canonical Temps plein

    Overview Join to apply for the Senior/Staff/Principal Engineer role at Canonical. Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation, and IoT....

  • Principal Test Engineer

    il y a 2 semaines


    Paris, France MA Com Technolgy Solutions Temps plein

    Headquartered in Lowell, Massachusetts, MACOM is certified to the ISO9001 international quality standard and ISO14001 environmental management standard. MACOM has multiple design centers, Si, GaAs and InP fabrication, manufacturing, assembly and test, and operational facilities throughout North America, Europe, Asia and Australia. In addition, MACOM offers...

  • Fullstack Engineer JS

    il y a 2 jours


    Paris, France Urban Linker Temps plein

    DESCRIPTION DU POSTELéquipe technique/produit totalise 70 personnes réparties en plusieurs pôles et squads. Vous intégrerez lun des pôles composés de 5 squads.La squad est gérée par un Engineering Manager et gère 4 développeurs.Vos principales missions :Améliorer et étendre les fonctionnalités du produit.Explorer et mettre en œuvre des...


  • Paris, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Contrat renouvelable **:Oui **Niveau de diplôme exigé **:Thèse ou équivalent **Fonction **:Ingénieur scientifique contractuel **Contexte et atouts du poste**: **Within the framework of the PEPR SN SMATCH and in collaboration with the PreMeDICaL Inria team.** This...

  • Founding Growth | SaaS

    il y a 2 jours


    Paris, France Urban Linker Temps plein

    DESCRIPTION DU POSTEEn tant que Founding Growth, vous ne venez pas simplement pour exécuter des campagnes, mais pour définir, déployer et posséder l'intégralité de leur stack Go-To-Market (GTM). Vous travaillez directement avec les fondateurs pour transformer leur moteur de croissance en une machine automatisée et ultra-performante.Vos missions...


  • Paris, France Inria Temps plein

    Le descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat**: CDD **Contrat renouvelable**: Oui **Niveau de diplôme exigé**: Thèse ou équivalent **Fonction**: Ingénieur scientifique contractuel **Contexte et atouts du poste**: **Within the framework of the PEPR SN SMATCH.** This research project focuses on integrating mechanistic...

Principal Coding Annotator

il y a 3 semaines


Paris, Île-de-France Braintrust Temps plein

Job Description
*This is a contracting engagement - initially 6 months - with potential for long term engagement.
Location: Paris-based preferred; alternatively Europe remote for strong candidates
We are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation team. This role sits at the intersection of
real-world software engineering, model evaluation, and applied AI*
, and is critical to improving model reliability, reasoning, and code quality.

You will design challenging coding tasks, evaluate model outputs against rigorous benchmarks, identify failure modes, and contribute to reinforcement learning and model improvement workflows.

This is
*not*
a junior annotation role. We are looking for practitioners with deep hands-on coding experience who can think like both an engineer and an evaluator.

What You'll Do

  • Create high-quality coding prompts and reference answers (benchmark-style, e.g. SWE-Bench-like problems).
  • Evaluate LLM outputs for code generation, refactoring, debugging, and implementation tasks.
  • Identify and document model failures, edge cases, and reasoning gaps.
  • Perform head-to-head evaluations between private LLMs (Mistral-based) and leading external models.
  • Build or configure coding environments to support evaluation and reinforcement learning (RL).
  • Follow detailed annotation and evaluation guidelines with high consistency.

What We're Looking For

  • 10+ years of professional software development experience.
  • Strong Python skills (required).
  • Knowledge of at least one additional programming language (bonus).
  • 1+ year of coding annotation and/or LLM evaluation experience (part-time OK) for a major frontier AI lab or AI infrastructure company.
  • Prior code reviewer experience is a plus.
  • Proven ability to apply structured evaluation criteria and write clear technical feedback.
  • Fluent in English (written and spoken).
  • Team lead or mentoring experience is a strong plus.

Why This Role

  • Work hands-on with cutting-edge LLMs.
  • Apply real-world engineering judgment to model evaluation and improvement.
  • High-impact, technical work with a focused, senior team.