Junior Coding Annotator

il y a 3 jours

Greater Paris Metropolitan Region, France TransPerfect Temps plein

Work Location:
Paris, France (onsite)

Engagement Model:
Part time employment

Weekly Workload:
25 hours per week

DataForce is seeking skilled
Software Engineers
to join our team as
Coding Annotators
to support the development and evaluation of advanced AI models. This role focuses on creating high-quality coding prompts and answers, benchmarking model performance, and identifying failure cases across internal and competitor models. Candidates will contribute to building realistic evaluation environments and supporting reinforcement learning workflows.

Role Summary:

The Coding Annotator will be responsible for creating programming prompts and reference solutions aligned with industry benchmarks, such as SWE-Bench and Terminal-Bench. The role involves testing model outputs to identify failures.

The annotator will also support reinforcement learning workflows by building and maintaining coding environments and executing coding-specific validation checks. This role does not involve quality checking Annotator++ outputs, but instead focuses on domain-specific evaluation, benchmarking, and technical analysis to surface model limitations and performance insights.

Key Responsibilities:

  • Create high-quality coding prompts and reference solutions aligned with industry benchmarks such as SWE-Bench and Terminal-Bench.
  • Develop prompts focused on code refactoring, code generation, and problem-solving scenarios.
  • Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning, correctness, and execution.
  • Design and maintain coding environments used for evaluation and reinforcement learning (RL) pipelines.
  • Execute coding-specific validation checks using established criteria and tools provided by other annotation teams.
  • Document findings, evaluation results, and insights to support model improvement and training strategies.
  • Perform detailed code reviews and annotations for accuracy and compliance.
  • Work with Python and front-end technologies (JavaScript, TypeScript); potentially with Java, too.
  • Execute repetitive tasks with precision and maintain high standards of quality.
  • Collaborate with cross-functional teams to improve code quality and documentation.

Job requirements

  • Strong proficiency in Python and front-end languages (JavaScript, TypeScript).
  • Experience with Java is a plus.
  • Demonstrated experience in code review and quality assurance.
  • Ability to handle repetitive tasks with attention to detail.
  • Fresh graduate in Computer Science or a related field; no prior work experience required.
  • Excellent written and verbal communication skills in English.

Education
:

  • Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a closely related technical field is required.

***

DataForce by TransPerfect is part of the TransPerfect family of companies, the world's largest provider of language and technology solutions for global business, with offices in more than 100 cities worldwide.

We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering, enriching and processing data for Machine Learning in different AI domains.

To learn more about DataForce please visit us at

.

  • Senior Coding Annotator

    il y a 3 jours

    Paris, Île-de-France Braintrust Temps plein

    Job Description*This is a contracting engagement - initially 6 months - with potential for long term engagement.Location: Paris-based preferred; alternatively Europe remote for strong candidatesWe are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation...

  • Ai Data Annotator: Coding

    il y a 3 jours

    Paris, France A French Artificial Intelligence Startup Temps plein

    HireArt is helping our client, a French Artificial Intelligence Research company, find an experienced and highly skilled AI Data Annotator to work in our client’s office and be one of the first members of their Data Annotation team. In this role, you will support the effectiveness of the company's human data collection by providing high-quality AI training...

  • Junior Freelance Legal Annotator

    il y a 1 semaine

    Paris, France DiliTrust Temps plein

    Junior Freelance Legal Annotator Ready to be part of the Legal Tech revolution? Vision: As a leading software-as-a-service (SaaS) provider, Dilitrust is a global company dedicated to offering an integrated suite of legal and governance products. Our vision is to digitize legal departments worldwide. With an annual growth rate of over 40% since 2020, our...

  • AI Evaluation Engineer

    il y a 3 jours

    Greater Paris Metropolitan Region, France Braintrust Temps plein

    Job DescriptionThis is a contracting engagement - initially 6 months - with potential for long term engagement.Location: Paris-based preferred; alternatively Europe remote for strong candidatesWe are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation...

  • Junior Freelance Legal Annotator

    il y a 1 semaine

    Paris, Île-de-France DiliTrust Temps plein

    Ready to be part of the Legal Tech revolution?Vision: As a leading software-as-a-service (SaaS) provider, Dilitrust is a global company dedicated to offering an integrated suite of legal and governance products. Our vision is to digitize legal departments worldwide. With an annual growth rate of over 40% since 2020, our ambition is to become the world's...

  • Junior AI-Driven Software Engineer

    il y a 7 jours

    Paris, France OVRSEA Temps plein

    A next-generation digital freight forwarder is seeking a Junior Software Engineer with an AI-native mindset to enhance engineering processes and workflows. The ideal candidate should be comfortable using AI tools like ChatGPT and eager to apply coding skills in TypeScript or Python. This role involves building tools for automation and improving the developer...

  • Data Quality Specialist, AI Tutor

    il y a 1 semaine

    Paris, Île-de-France Mistral AI Temps plein

    About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is...

  • Data Quality Specialist, AI Tutor

    il y a 1 semaine

    Paris, France Mistral AI Temps plein

    About MistralAt Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to...

  • Annotators - Japanese Speakers in Paris

    il y a 3 jours

    Paris, France DataForce by TransPerfect Temps plein

    **Work location**:on-site, Paris (France) **Engagement model**:Temporary Employment (6 month, with possible extension) **Workload**:25 hours/week **Project start**: January 2026 **Languages required**: Japanese and English DataForce by Transperfect is seeking a detail-oriented and linguistically skilled professional to design and evaluate user prompts...

  • Annotators - Korean Speakers in Paris

    il y a 3 jours

    Paris, France DataForce by TransPerfect Temps plein

    **Work location**:on-site, Paris (France) **Engagement model**:Temporary Employment (6 month, with possible extension) **Workload**:25 hours/week **Project start**: January 2026 **Languages required**: Korean and English DataForce by Transperfect is seeking a detail-oriented and linguistically skilled professional to design and evaluate user prompts for...