Catalan Audio Generalist Evaluator

About Mercor

Mercor connects top experts with leading AI labs and research organizations to train frontier AI systems using human expertise.

Role Overview

Mercor is seeking a Catalan Audio Generalist Evaluator to contribute to a high-impact audio AI research project.

In this role, you will work on transcription, annotation, and evaluation tasks to help train and benchmark advanced AI models, focusing on Catalan audio and language tasks.

Key Responsibilities

Transcribe and Optimize Audio & Video

• Listen to, analyze, and transcribe Catalan audio and video content
• Produce high-quality written outputs in Catalan and English
• Ensure accuracy, clarity, and adherence to formatting guidelines
• Capture tone, intent, and regional variations

Define and Document Evaluation Standards

• Develop evaluation rubrics and grading guidelines
• Establish quality standards for model outputs
• Document linguistic nuances and edge cases

Conduct Model Testing and Grading

• Run prompts through AI models and evaluate outputs
• Assess responses for accuracy, fluency, and completeness
• Provide structured feedback for model improvement

Support Benchmarking and Quality Assurance

• Participate in QA and review cycles
• Ensure consistency and reliability of datasets
• Collaborate with project leads to refine tasks

Required Skills & Qualifications

• Native or near-native proficiency in Catalan
• Professional fluency in English
• Strong writing, editing, and analytical skills
• Ability to transcribe and analyze Catalan audio accurately
• Strong attention to detail and ability to follow guidelines
• Ability to work independently and meet deadlines
• Availability for 10–20 hours per week

Preferred Qualifications

• Background in linguistics, humanities, journalism, or related fields
• Experience in transcription, annotation, or localization
• Familiarity with Catalan dialects and variations
• Interest in AI, language models, or research workflows

Work Details

• Commitment: 10–20 hours per week
• Work Type: Fully remote and flexible
• Engagement: Independent contractor

Application Process

• Complete a short AI-led interview (~15 minutes)
• Selected candidates will be onboarded and assigned tasks

Contract & Payment Terms

• Independent contractor engagement
• Weekly payments via Stripe or Wise
• Flexible schedule
• Projects may be extended or concluded based on performance

Additional Notes

• High-impact role in AI audio research and evaluation
• Ideal for candidates interested in language technology and research