Linguist | Upto 36/hr Hourly

il y a 20 heures

SaintMartinLacaussade, Nouvelle-Aquitaine, France Mercor Temps plein

About The Job
Mercor
connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark
,
General Catalyst
,
Peter Thiel
,
Adam D'Angelo
,
Larry Summers
, and
Jack Dorsey
.

Position:
AI Model Evaluator

Type:
Full-time or Part-time Contract Work
Compensation:
$36/hour
Location:
Geography restricted to Europe, Canada (Quebec), USA
Role Responsibilities

  • Evaluate LLM-generated responses on their ability to effectively answer user queries.
  • Conduct fact-checking using trusted public sources and external tools.
  • Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.
  • Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications
Must-Have

  • Bachelor's degree
  • Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in French
  • Significant experience using large language models (LLMs)
  • Excellent writing skills
  • Strong attention to detail
  • Adaptable and comfortable moving across topics, domains, and customer requirements
  • Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
  • Excellent college-level mathematics skills

Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments
  • Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,

  • Translator | Upto 40/hr Hourly

    il y a 4 jours

    Saint-Martin-Lacaussade, Nouvelle-Aquitaine, France Mercor Temps plein

    About The JobMercorconnects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors includeBenchmark,General Catalyst,Peter Thiel,Adam D'Angelo,Larry Summers, andJack Dorsey.Position:Bilingual Translation Quality SpecialistType:Project-basedCompensation:$35–$40/hourLocation:RemoteRole...

  • Senior Health and Social Care Support Worker

    il y a 4 jours

    Isle-Saint-Georges, Nouvelle-Aquitaine, France NHS Highland Temps plein

    **Looking for a job that makes a difference?Are you understanding and dependable?Are you patient and compassionate?**The Care at Home team are recruiting for Health and Social Care Support Worker roles throughout the north Skye area.Training and development from entry-level to managementSecure pay and pensionVarious Hours and shift combinations from 10.5hrs...

  • Lawyer | Upto $105/hr Hourly

    il y a 2 jours

    Lacaussade, France Mercor Temps plein

    Lawyer | Upto $105/hr Hourly 1 day ago Be among the first 25 applicants This range is provided by Mercor. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $105.00/hr - $105.00/hr About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered...

  • Localization Specialist | Upto $40/hr Hourly

    il y a 2 jours

    Lacaussade, France Mercor Temps plein

    About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position Bilingual Translation Quality Specialist Type Project-based Compensation $35–$40/hour Location Remote Role...

  • Freelance Translator | Upto $40/hr Hourly

    il y a 2 jours

    Lacaussade, France Mercor Temps plein

    About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position Details Position: Bilingual English–Italian Language Expert Type: Contract Compensation: $35–$40/hour...

  • Soccer Expert

    il y a 2 jours

    Lacaussade, France Mercor Temps plein

    About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position Soccer Expert Type Contract Compensation $19–$66/hour Duration Weekend of December 20 Role Responsibilities...

  • Assistant Adv

    il y a 2 semaines

    Saint-Marcel, France Menco Evreux Temps plein

    **Nous recherchons pour l'un de nos clients un(e) assistant(e) ADV H/F** **Vos missions**: - Administrer les dossiers des clients - Enregistrer les commandes et assurer leur suivi - Réaliser les bons de commande ainsi que les devis et la facturation - Gestion des stocks. - Vous devez être doté(e) d'une excellentes connaissances en administration des...

  • Educateur de Jeunes Enfants

    il y a 2 semaines

    Saint-Cloud, France people and baby Temps plein

    Chaque jour, notre équipe de professionnels spécialiste de la petite enfance accueille 36 enfants âgés de 10 semaines à 3 ans répartis en trois sections. Bébés, moyens et grands évoluent ainsi dans un cadre de vie convivial, sécurisé et adapté aux besoins des tout-petits. A la crèche Ladybird, l’équipe bilingue français-anglais parle tous...

  • HR Teacher Recruitment

    il y a 2 semaines

    Saint-Ouen, France Cercle des Langues Temps plein

    **DESCRIPTION DU POSTE** Au sein du pôle Pedagogy et accompagné par notre Pedagogy Manager Francesco, vous allez nous aider dans le recrutement de nos professeurs. Les critères principaux pour la sélection de nos professeurs sont leurs capacités pédagogiques, leur connaissance de la langue anglaise et leur aisance avec les outils numériques. Ils...

  • Electromecanicien H/F

    il y a 3 semaines

    Saint-Nazaire, France Nextep HR Temps plein

    Devenez Électromécanicien H/F en CDI et prenez en charge la gestion d'un parc technique chez nos clients à Saint-Nazaire ! En tant que véritable expert, vous assurez la conduite, l'entretien, la maintenance et le dépannage des installations process, tout en proposant des améliorations de fonctionnement et de performance pour garantir un service de...

  • Serrurier - Métallier (H/F)

    il y a 6 jours

    Saint-Louis, France INSTITUT FRANCO-ALLEMAND de RECHERCHES de SAINT-LOUIS Temps plein

    L’**Institut franco-allemand de recherches de Saint-Louis (ISL)**, situé en France au cœur de la région des Trois Frontières, aux portes de l’Allemagne et de la Suisse, est un organisme de recherches reconnu au niveau international et fortement ancré dans un réseau scientifique et industriel global. Nos axes de recherches mettent l’accent sur...

  • Coordinateur Communication Et Documentation

    il y a 2 semaines

    Saint-Louis, France INSTITUT FRANCO-ALLEMAND de RECHERCHES de SAINT-LOUIS Temps plein

    L’**Institut franco-allemand de recherches de Saint-Louis (ISL)**, situé en France au cœur de la région des Trois Frontières, aux portes de l’Allemagne et de la Suisse, est un organisme de recherches reconnu au niveau international et fortement ancré dans un réseau scientifique et industriel global. Nos axes de recherches mettent l’accent sur...