Principal Coding Annotator

il y a 2 jours


Paris, France Braintrust Temps plein

OverviewThis is a contracting engagement - initially 6 months - with potential for long term engagement. Location: Paris-based preferred; alternatively Europe remote for strong candidates. What You’ll DoCreate high-quality coding prompts and reference answers (benchmark-style, e.g. SWE-Bench-like problems).

Evaluate LLM outputs for code generation, refactoring, debugging, and implementation tasks. Identify and document model failures, edge cases, and reasoning gaps. Perform head-to-head evaluations between private LLMs (Mistral-based) and leading external models. Build or configure coding environments to support evaluation and reinforcement learning (RL).

Follow detailed annotation and evaluation guidelines with high consistency. What We’re Looking For10+ years of professional software development experience. Strong Python skills (required). Knowledge of at least one additional programming language (bonus).1+ year of coding annotation and/or LLM evaluation experience (part-time OK) for a major frontier AI lab or AI infrastructure company.

Prior code reviewer experience is a plus. Proven ability to apply structured evaluation criteria and write clear technical feedback. Fluent in English (written and spoken). Team lead or mentoring experience is a strong plus.

Why This RoleWork hands-on with cutting-edge LLMs. Apply real-world engineering judgment to model evaluation and improvement. High-impact, technical work with a focused, senior team. #J-18808-Ljbffr


  • Junior Coding Annotator

    il y a 3 semaines


    Greater Paris Metropolitan Region, France TransPerfect Temps plein

    Work Location:Paris, France (onsite)Engagement Model:Part time employmentWeekly Workload:25 hours per weekDataForce is seeking skilledSoftware Engineersto join our team asCoding Annotatorsto support the development and evaluation of advanced AI models. This role focuses on creating high-quality coding prompts and answers, benchmarking model performance, and...

  • Principal Coding Annotator

    il y a 3 semaines


    Paris, Île-de-France Braintrust Temps plein

    Job Description*This is a contracting engagement - initially 6 months - with potential for long term engagement.Location: Paris-based preferred; alternatively Europe remote for strong candidatesWe are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation...

  • Senior Coding Annotator

    il y a 2 semaines


    Paris, France Braintrust Temps plein

    Job Description This is a contracting engagement - initially 6 months - with potential for long term engagement. Location: Paris-based preferred; alternatively Europe remote for strong candidates We are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and...


  • Paris, Île-de-France STATION F Temps plein

    AboutDfns is the leading Wallets-as-a-Service (WaaS) platform, helping fintechs, institutions, and enterprises simplify digital asset management and securely onboard users onchain.Its API-first wallet platform unifies transaction management, workflow governance, key deployment, and third-party integrations into one secure operating system for blockchains....


  • Paris, Île-de-France TransPerfect Temps plein

    Work location:on-site, Paris (France)Engagement model:Temporary Employment (approx. 3 months, with possible extension)Workload:25 hours/weekProject start:February 2026Languages required:Chinese (Mandarin) and EnglishDataForce by Transperfect is seeking a detail-oriented and linguistically skilled professional to design and evaluate user prompts for AI...

  • Principal Data Scientist

    il y a 7 jours


    Paris, France Talented International Temps plein

    About Us We are a start-up based in Munich, Madrid and in Barcelona. We were founded in Spring 2020 and two and a half years later we are now already a team of +80 super motivated ML Engineers, data scientists and developers. Our mission is to build beautiful Artificial Intelligence products. We’re curious, passionate, and relentless in our drive to...

  • Principal Transport Modeller

    il y a 3 semaines


    Paris, Île-de-France Aimsun Temps plein

    Aimsun is an international leader in digital mobility solutions for transportation authorities, highway agencies, public transit operators and consultancies. Aimsun's simulation and predictive data analytics help customers to understand transportation network performance, to predict its future evolution, and to support decision making.Whether the scope of...


  • Paris, Île-de-France Ipsen Temps plein

    PositionJob Title: Principal Statistical ProgrammerDivision / Function: Statistical Programming, Global BiometrySummary / purpose of the positionPosition will participate in production/QC programming, project coordination, CRO management and oversight of vendor programming across Ipsen rare disease studiesMain responsibilities / job expectationsTo ensure the...


  • Paris, France Ogury Temps plein

    Ogury is** a global adtech company** that delivers Personified Advertising solutions grounded in privacy to brands, agencies and publishers by focusing on targeting personas, not people. - We deliver relevant audiences at scale and on quality publisher inventory thanks to **our exclusive data**, which is meticulously collected and crafted from millions of**...

  • Lead Transport Modeller

    Il y a 20 minutes


    Paris, France Aimsun Temps plein

    A leading digital mobility solutions firm in Paris is seeking an experienced Principal Transport Modeller / Project Manager. The successful candidate will lead transport modeling projects, manage client relationships, and mentor junior team members. Ideal applicants will have a degree in a relevant discipline, strong project management skills, and a...