Back to remote jobs

Internet-Native Bilingual Evaluator Expert (French)

Mercor

Bilingual LLM Evaluator Contractor · Part-time
Remote (Global) $50 – $50/hr June 19, 2026

Job description

Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to advanced AI research focused on multilingual communication, internet culture, and real-world language use.

This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humor, memes, and social norms differ across languages and regions.

Job Responsibilities

Evaluate Internet-Native Communication

  • Analyze content from French- and English-speaking online communities

  • Evaluate AI-generated outputs for:

    • Linguistic accuracy
    • Cultural relevance
    • Internet authenticity
  • Identify issues involving:

    • Slang
    • Memes
    • Cultural references
    • Sarcasm
    • Code-switching
    • Platform-specific language

Develop Evaluation Standards

  • Build evaluation rubrics for bilingual internet communication

  • Define standards for:

    • Culturally appropriate language
    • Platform-native communication
    • Contextual accuracy
  • Document linguistic and cultural edge cases

Conduct Model Testing and Feedback

  • Test language models using real-world bilingual prompts

  • Evaluate outputs in:

    • French
    • English
  • Provide detailed feedback to improve multilingual model performance

Support Quality Assurance

  • Participate in QA reviews
  • Assist with benchmark creation
  • Ensure consistency across evaluators and datasets

Minimum Qualifications

  • Native or near-native fluency in French

  • Professional fluency in English

  • Strong familiarity with online communities across:

    • France
    • Québec
    • Belgium
    • Switzerland
    • Other French-speaking regions
  • Active participation in internet culture in both languages

  • Strong:

    • Writing skills
    • Analytical skills
    • Critical thinking skills
  • Availability of 10–20 hours per week

Preferred Qualifications

Background in:

  • Linguistics
  • Translation
  • Localization
  • Social Media
  • Journalism
  • Humanities
  • AI Evaluation

Additional experience with:

  • Online content evaluation
  • Internet-native communication analysis
  • Digital communities and online culture

Preferred Knowledge

  • European French
  • Québec French
  • Belgian French
  • Swiss French
  • Regional language differences and localization expectations

Interest in:

  • Artificial Intelligence
  • Language Models
  • Multilingual Language Technologies

Contract & Payment Terms

  • Independent contractor engagement
  • Fully remote work
  • Flexible schedule
  • Weekly payments through Stripe or Wise
  • Projects may be extended, shortened, or concluded based on business needs and performance

Important Note

Mercor currently cannot support:

  • H1-B candidates
  • STEM OPT candidates

About Mercor

Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.

Contributors help shape the future of multilingual AI by improving how models understand internet-native communication across languages, cultures, and online communities.

Apply now

You will be redirected to the company's website to complete your application.

Apply now

Stay in the loop.

One email per week, 5 hand-picked roles.