Seeking bilingual Spanish-English internet culture experts with deep knowledge of Latin American online communities to evaluate AI-generated content and improve multilingual AI understanding of slang, memes, digital trends, and internet-native communication.
Internet-Native Bilingual Evaluator Expert (French)
Job description
Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to advanced AI research focused on multilingual communication, internet culture, and real-world language use.
This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humor, memes, and social norms differ across languages and regions.
Job Responsibilities
Evaluate Internet-Native Communication
Analyze content from French- and English-speaking online communities
Evaluate AI-generated outputs for:
- Linguistic accuracy
- Cultural relevance
- Internet authenticity
Identify issues involving:
- Slang
- Memes
- Cultural references
- Sarcasm
- Code-switching
- Platform-specific language
Develop Evaluation Standards
Build evaluation rubrics for bilingual internet communication
Define standards for:
- Culturally appropriate language
- Platform-native communication
- Contextual accuracy
Document linguistic and cultural edge cases
Conduct Model Testing and Feedback
Test language models using real-world bilingual prompts
Evaluate outputs in:
- French
- English
Provide detailed feedback to improve multilingual model performance
Support Quality Assurance
- Participate in QA reviews
- Assist with benchmark creation
- Ensure consistency across evaluators and datasets
Minimum Qualifications
Native or near-native fluency in French
Professional fluency in English
Strong familiarity with online communities across:
- France
- Québec
- Belgium
- Switzerland
- Other French-speaking regions
Active participation in internet culture in both languages
Strong:
- Writing skills
- Analytical skills
- Critical thinking skills
Availability of 10–20 hours per week
Preferred Qualifications
Background in:
- Linguistics
- Translation
- Localization
- Social Media
- Journalism
- Humanities
- AI Evaluation
Additional experience with:
- Online content evaluation
- Internet-native communication analysis
- Digital communities and online culture
Preferred Knowledge
- European French
- Québec French
- Belgian French
- Swiss French
- Regional language differences and localization expectations
Interest in:
- Artificial Intelligence
- Language Models
- Multilingual Language Technologies
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work
- Flexible schedule
- Weekly payments through Stripe or Wise
- Projects may be extended, shortened, or concluded based on business needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.
Contributors help shape the future of multilingual AI by improving how models understand internet-native communication across languages, cultures, and online communities.
You will be redirected to the company's website to complete your application.