Internet-Native Bilingual Evaluator Expert (Spanish – Spain)

Mercor is seeking Internet-Native Bilingual Evaluator Experts (Spanish–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use.

In this role, you will evaluate, annotate, and improve AI model outputs across English and Spanish, helping ensure that models accurately understand modern online communication, cultural references, slang, memes, and multilingual interactions.

This position specifically focuses on Spanish internet culture, language usage, and online communities in Spain.

Job Responsibilities

Evaluate Internet-Native Communication

• Analyze content originating from:

  • Social media platforms
  • Online forums
  • Messaging applications
  • Online communities
  • Consumer-facing digital environments

• Assess AI-generated responses for:

  • Naturalness
  • Fluency
  • Cultural appropriateness
  • Internet authenticity

• Identify issues involving:

  • Slang
  • Memes
  • Abbreviations
  • Code-switching
  • Emerging internet language

• Evaluate content specific to:

  • Spanish internet culture
  • Online trends in Spain
  • Spain-based digital communities

Develop Evaluation Standards

• Create detailed rubrics and evaluation guidelines

• Define standards for:

  • Tone
  • Cultural relevance
  • Contextual understanding
  • Linguistic accuracy

• Document edge cases involving:

  • Humor
  • Sarcasm
  • Memes
  • Platform-specific communication

• Identify distinctions between:

  • Peninsular Spanish
  • Latin American Spanish

Conduct Model Testing and Feedback

• Test language models using real-world multilingual prompts

• Evaluate outputs in:

  • Spanish
  • English

• Provide structured feedback to improve:

  • Model quality
  • Cultural understanding
  • Language accuracy

Support Quality Assurance

• Participate in review cycles
• Contribute to benchmark development
• Collaborate with project leads on evaluation frameworks
• Maintain consistency across datasets and review processes

Minimum Qualifications

• Native or near-native fluency in Spanish (Spain)
• Professional fluency in English
• Deep familiarity with Spain-based internet culture and online communities

Active Participation In Platforms Such As

• YouTube
• TikTok
• Reddit
• Discord
• X
• Instagram
• Twitch
• Forocoches
• Similar online ecosystems

Required Skills

• Strong understanding of:

  • Peninsular Spanish slang
  • Internet memes
  • Internet humor
  • Contemporary digital culture

• Strong:

  • Writing skills
  • Analytical thinking
  • Critical thinking

• Availability of 10–20 hours per week

Preferred Qualifications

Background in:

• Content Moderation
• Localization
• Translation
• Linguistics
• Social Media
• Journalism
• AI Evaluation

Additional Preferred Knowledge

• Differences between Spain Spanish and Latin American Spanish online discourse
• User-generated content evaluation
• Digital communication analysis
• Internet culture research

Interest in:

• Artificial Intelligence
• Language Models
• Internet Culture Research

Contract & Payment Terms

• Independent contractor engagement
• Fully remote work
• Flexible schedule
• Weekly payments through Stripe or Wise
• Projects may be extended, shortened, or concluded based on business needs and performance

Important Note

Mercor currently cannot support:

• H1-B candidates
• STEM OPT candidates

About Mercor

Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.

Contributors help shape the future of multilingual AI by improving how models understand internet-native communication, regional language variation, and digital culture in Spain.