Galician Audio Generalist Evaluator

About Mercor

Mercor connects top experts with leading AI labs and research organizations to train frontier AI systems using human expertise.

Role Overview

Mercor is seeking a Galician Audio Generalist Evaluator to support a high-impact audio AI research project.

In this role, you will work on transcription, annotation, and evaluation tasks to help train and benchmark advanced AI models, focusing on Galician audio and language tasks.

Key Responsibilities

Transcribe and Optimize Audio & Video

• Listen to, analyze, and transcribe Galician audio and video content
• Produce high-quality written outputs in Galician and English
• Ensure accuracy, clarity, and adherence to formatting guidelines
• Capture tone, intent, and regional variations

Define and Document Evaluation Standards

• Develop evaluation rubrics and grading guidelines
• Establish quality benchmarks for model outputs
• Document linguistic nuances and edge cases

Conduct Model Testing and Grading

• Run prompts through AI models and evaluate outputs
• Assess responses for accuracy, fluency, and completeness
• Provide structured feedback to improve model performance

Support Benchmarking and Quality Assurance

• Participate in QA and review cycles
• Ensure consistency and dataset reliability
• Collaborate with project leads to refine evaluation processes

Required Skills & Qualifications

• Native or near-native proficiency in Galician
• Professional fluency in English
• Strong writing, editing, and analytical skills
• Ability to transcribe and analyze audio accurately
• High attention to detail and adherence to guidelines
• Ability to work independently and meet deadlines
• Availability for 10–20 hours per week

Preferred Qualifications

• Background in linguistics, humanities, journalism, or related fields
• Experience in transcription, annotation, or localization
• Familiarity with Galician dialects and variations
• Interest in AI, language models, or research workflows

Work Details

• Commitment: 10–20 hours per week
• Work Type: Fully remote and flexible
• Engagement: Independent contractor

Application Process

• Complete a short AI-led interview (~15 minutes)
• Selected candidates will be onboarded and assigned tasks

Contract & Payment Terms

• Independent contractor engagement
• Weekly payments via Stripe or Wise
• Flexible schedule
• Projects may be extended or concluded based on performance

Additional Notes

• High-impact role in AI audio research and evaluation
• Ideal for candidates interested in language technology and research