Internet-Native Bilingual Evaluator Expert (Spanish – Latin America)

Mercor is seeking Internet-Native Bilingual Evaluator Experts (Spanish–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use.

In this role, you will evaluate, annotate, and improve AI model outputs across English and Spanish, helping ensure that models accurately understand modern online communication, cultural references, slang, memes, and multilingual interactions.

This position specifically focuses on Latin American Spanish internet culture, language usage, digital communities, and regional online trends.

Job Responsibilities

Evaluate Internet-Native Communication

• Analyze content originating from:

  • Social media platforms
  • Online forums
  • Messaging applications
  • Online communities
  • Consumer-facing digital environments

• Assess AI-generated responses for:

  • Naturalness
  • Fluency
  • Cultural appropriateness
  • Internet authenticity

• Identify issues involving:

  • Slang
  • Memes
  • Abbreviations
  • Code-switching
  • Emerging internet language

• Evaluate content specific to:

  • Latin American internet culture
  • Regional trends
  • Online communities across Spanish-speaking countries

Develop Evaluation Standards

• Create detailed rubrics and evaluation guidelines

• Define standards for:

  • Tone
  • Cultural relevance
  • Contextual understanding
  • Linguistic accuracy

• Document edge cases involving:

  • Humor
  • Sarcasm
  • Memes
  • Platform-specific communication

• Identify linguistic and cultural differences across major Latin American Spanish-speaking countries

Conduct Model Testing and Feedback

• Test language models using real-world multilingual prompts

• Evaluate outputs in:

  • Spanish
  • English

• Provide structured feedback to improve:

  • Model quality
  • Cultural understanding
  • Language accuracy

Support Quality Assurance

• Participate in review cycles
• Contribute to benchmark development
• Collaborate with project leads on evaluation frameworks
• Maintain consistency across datasets and review processes

Minimum Qualifications

• Native or near-native fluency in Latin American Spanish
• Professional fluency in English
• Deep familiarity with internet culture and online communities across one or more Spanish-speaking countries in Latin America

Active Participation In Platforms Such As

• YouTube
• TikTok
• Reddit
• Discord
• X
• Instagram
• Twitch
• Facebook
• WhatsApp Communities
• Similar online ecosystems

Required Skills

• Strong understanding of:

  • Latin American Spanish slang
  • Internet memes
  • Internet humor
  • Contemporary digital culture

• Strong:

  • Writing skills
  • Analytical thinking
  • Critical thinking

• Availability of 10–20 hours per week

Preferred Qualifications

Background in:

• Content Moderation
• Localization
• Translation
• Linguistics
• Social Media
• Journalism
• AI Evaluation

Additional Preferred Knowledge

• Regional language differences across:

  • Mexico
  • Argentina
  • Colombia
  • Chile
  • Peru
  • Other Spanish-speaking countries

• User-generated content evaluation

• Digital communication analysis

• Internet culture research

Interest in:

• Artificial Intelligence
• Language Models
• Internet Culture Research

Contract & Payment Terms

• Independent contractor engagement
• Fully remote work
• Flexible schedule
• Weekly payments through Stripe or Wise
• Projects may be extended, shortened, or concluded based on business needs and performance

Important Note

Mercor currently cannot support:

• H1-B candidates
• STEM OPT candidates

About Mercor

Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.

Contributors help shape the future of multilingual AI by improving how models understand internet-native communication, regional language variation, and digital culture across Latin America.