Lithuanian Audio Generalist Evaluator Expert

About the Role

Mercor is seeking a Lithuanian Audio Generalist Evaluator Expert to contribute to a high-impact AI research project focused on multilingual audio data.

In this role, you will perform transcription, annotation, and evaluation tasks that help train and benchmark advanced language models.

This short-term engagement is ideal for candidates with strong analytical skills who are fluent in Lithuanian and English and enjoy transforming complex audio and visual information into clear, structured text.

Key Responsibilities

Transcribe and Optimize Audio & Video

• Listen to, analyze, and transcribe Lithuanian audio and video content
• Produce high-quality written outputs in Lithuanian, with supporting work in English when required
• Ensure accuracy and adherence to formatting and stylistic guidelines
• Capture linguistic nuances such as tone, intent, register, and regional variations

Define and Document Evaluation Standards

• Establish expectations for high-quality responses in consumer audio tasks
• Develop evaluation rubrics and grading guidelines
• Document standards to ensure consistency across reviewers
• Identify linguistic edge cases and grammatical complexities

Conduct Model Testing and Grading

• Run prompts through AI models and evaluate generated responses
• Assess outputs for accuracy, completeness, fluency, and clarity
• Provide structured feedback to improve AI model performance

Support Benchmarking and Quality Assurance

• Participate in quality assurance reviews
• Ensure datasets meet Mercor’s quality standards
• Collaborate with project leads to resolve task ambiguities

Minimum Qualifications

• Strong writing, editing, and analytical skills
• Ability to work independently and meet deadlines
• Native or near-native fluency in Lithuanian
• Professional fluency in English
• Ability to accurately transcribe and analyze Lithuanian audio
• Availability to commit 10–20 hours per week

Preferred Qualifications

• College students or recent graduates
• Background in linguistics, journalism, humanities, or social sciences
• Experience with transcription, localization, or data annotation
• Familiarity with Lithuanian dialects such as:
• Aukštaitian
• Samogitian
• Interest in AI systems and language model research

Application Process

1. Complete a short AI-led interview (approximately 15 minutes)
2. If selected, receive onboarding instructions
3. Begin project work

Additional Role Details

• Structured project environment with clear guidelines and tools
• Hands-on experience with AI research and evaluation workflows
• Opportunity to contribute to multilingual AI model benchmarking

Contract & Payment Terms

• Independent contractor engagement
• Fully remote work schedule
• Weekly payments via Stripe or Wise
• Projects may be extended or shortened depending on performance

Please note: Mercor cannot support H1-B or STEM OPT candidates at this time.

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier AI models using human expertise.

Contributors collaborate with researchers and engineers to improve the accuracy, reasoning ability, and multilingual capabilities of next-generation AI systems.