Emplois actuels liés à Bilingual LLM Assessment Specialist Expert - SaintMartinLacaussade, Nouvelle-Aquitaine - Mercor

  • Spécialiste en support client

    il y a 5 jours

    Saint-Laurent-Médoc, Nouvelle-Aquitaine, France Harris Computer Temps plein

    Spécialiste en support client / Technicien(ne) en support informatiqueLieu : Montréal (Saint-Laurent – près du métro Côte-Vertu)Mode de travail : Hybride (télétravail/présentiel)Type d'emploi : Permanent, temps plein (37,5 heures/semaine)Description de l'emploi (Français)En tant que Spécialiste en support client / Technicien·ne en support...

  • Conversational AI Expert – Remote

    Il y a 28 minutes

    Lacaussade, France Mercor Temps plein

    About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: AI Model Evaluator Type: Full-time or Part-time Contract Work Compensation: $36/hour Location: Geography...

  • Consultant ou Consultante en évaluation

    il y a 2 semaines

    Seine-Saint-Denis, France AGENCE CADRES Temps plein

    Dans le cadre du déploiement de la politique RH, l'activité assessment center se développe fortement et soulève de nouveaux challenges dans l'évaluation des collaborateurs, futurs et actuels, du Groupe. Nos objectifs : apporter à ceux-ci un éclairage sur leurs compétences, les accompagner dans leur développement de carrière. En intégrant l'équipe...

  • Customer Experience Specialist

    Il y a 29 minutes

    Saint-Étienne, France Cross Borders Talents Temps plein

    OverviewPosition: Bilingual Customer Experience Specialist (French & English) WITH Relocation to Portugal. Kickstart your international career in sunny Portugal! Join a vibrant, supportive team in Lisbon or Porto and work with some of the world's leading brands as a Bilingual Customer Experience Specialist. Whether you’re looking for your first big move...

  • Client Service Specialist

    il y a 2 semaines

    Montbonnot-Saint-Martin, France Moody's Temps plein

    Moody's is a global integrated risk assessment firm that empowers organizations to make better decisions. Moody’s Analytics, Subsidiary company of Moody’s Corporation, is a world leader in tools and services in financial risk management. Grouping the non-credit rating activities of Moody’s, Moody’s Analytics offers its clients complete solutions...

  • Oracle EBS Automation Specialist

    Il y a 17 minutes

    Martin Rieux, France Qualitest acq Temps plein

    Qualitest is looking for a Senior Oracle EBS Automation Specialist to support remote projects by identifying automation opportunities, automating Oracle EBS test scenarios, and maintaining the existing automation framework using TestComplete. The role requires strong hands-on automation skills and the ability to work independently while collaborating with...

  • Physics Specialist Remote Role

    il y a 1 semaine

    Lacaussade, France Mercor Temps plein

    About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position Physics Expert Type Contract Compensation $60–$80/hour Location Remote Duration ~2 months, with extension...

  • Belgian Care Expert: Member Support

    il y a 1 semaine

    Saint-Pierre-d'Eyraud, France Alan Temps plein

    A leading healthcare company in France is seeking a User Care Expert to enhance customer experiences and solve member issues. You will engage with members through chat, email, and phone while also contributing to process improvements. The ideal candidate has 2+ years in customer support, is bilingual in English and Dutch, and possesses a passion for...

  • Stage Ingénieur Programmation Recherche Expertise H/F

    il y a 2 heures

    Saint-Martin-d'Hères, France Cstb Temps plein

    Contexte : Le secteur du bâtiment représente un quart des émissions françaises de gaz à effet de serre et fait l'objet d'efforts en conséquence. En 2022, la France est notamment passée d'une réglementation thermique à une réglementation environnementale de la filière construction, la RE2020, plus ambitieuse et exigeante. Le stage abordera la...

  • QA Specialist I

    il y a 7 jours

    Saint-Ouen-l’Aumône, Île-de-France Sensient Temps plein

    DescriptionChez Sensient Technologies, nous sommes des experts en science et en innovation dans le domaine de la couleur et des arômes. Nous sommes reconnus sur ces marchés sur le plan international.  Nous avons à cœur de trouver des solutions pour nos clients. Et nous serons meilleurs avec vous. Nous cherchons un responsable Système Qualité et...

  • Chargé de Recrutement

    il y a 2 semaines

    Saint-Vaize, France Expert & Manager Temps plein

    ANGERS 06 21 87 15 06 Créé en 2005 par des spécialistes en Ressources Humaines, Expert & Manager est un cabinet de chasse et de conseil en recrutement. Véritable recruteur de Talents, E&M appartient au Groupe Interaction depuis 2013 (Groupe Breton, 30 ans, 180 agences en France). Notre expertise repose sur la maîtrise de vos valeurs et de votre...

Bilingual LLM Assessment Specialist Expert

il y a 1 heure

SaintMartinLacaussade, Nouvelle-Aquitaine, France Mercor Temps plein

About The Job
Mercor
connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark
,
General Catalyst
,
Peter Thiel
,
Adam D'Angelo
,
Larry Summers
, and
Jack Dorsey
.

Position:
AI Model Evaluator

Type:
Full-time or Part-time Contract Work
Compensation:
$36/hour
Location:
Geography restricted to Europe, Canada (Quebec), USA
Role Responsibilities

  • Evaluate LLM-generated responses on their ability to effectively answer user queries.
  • Conduct fact-checking using trusted public sources and external tools.
  • Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.
  • Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications
Must-Have

  • Bachelor's degree
  • Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in French
  • Significant experience using large language models (LLMs)
  • Excellent writing skills
  • Strong attention to detail
  • Adaptable and comfortable moving across topics
  • Background or experience in domains requiring structured analytical thinking
  • Excellent college-level mathematics skills

Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments
  • Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,