Malay Audio Generalist Evaluator Expert

About the Role

Mercor is seeking a Malay Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project in collaboration with a leading AI research lab.

In this role, you will work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. This short-term project is ideal for candidates with strong analytical skills who are fluent in Malay and English and can translate audio and video content into precise, structured written outputs.

Job Responsibilities

Transcribe and Optimise Audio & Video

• Listen to and analyze audio and video content in Malay
• Produce accurate Malay transcriptions and written outputs
• Support tasks in English where required
• Follow detailed formatting and stylistic guidelines
• Capture linguistic nuances such as tone, intent, and regional variations

Define and Document Evaluation Standards

• Establish expectations for high-quality responses in consumer audio contexts
• Develop evaluation rubrics and grading frameworks in Malay and English
• Document standards to maintain consistency across evaluations
• Identify edge cases, ambiguities, and linguistic complexities in Malay

Conduct Model Testing and Grading

• Run prompts through language models
• Evaluate AI-generated responses for accuracy, fluency, completeness, and clarity
• Provide structured feedback to improve AI model performance

Support Benchmarking and Quality Assurance

• Participate in QA and review cycles
• Ensure tasks and outputs meet Mercor’s quality standards
• Collaborate with project leads to refine evaluation frameworks

Minimum Qualifications

• Strong writing, editing, and analytical skills
• Native or near-native fluency in Malay
• Professional fluency in English
• Ability to accurately transcribe and analyze Malay audio content
• Ability to work independently and meet deadlines
• Availability to commit 10–20 hours per week

Preferred Qualifications

• College students or recent graduates
• Background in linguistics, humanities, journalism, social sciences, or technical fields
• Experience in transcription, annotation, localization, or evaluation workflows
• Familiarity with Malay dialects and regional language variations
• Interest in AI, language models, or research environments

Application & Onboarding Process

1. Complete a short AI-led interview (approximately 15 minutes)
2. If selected, you will be onboarded and invited to begin project work

Additional Role Details

• Work in a structured project environment with defined tools and guidelines
• Gain exposure to real-world AI research workflows
• Contribute directly to improving multilingual AI models

Contract & Payment Terms

• Independent contractor engagement
• Fully remote work with flexible hours
• Projects may be extended or concluded depending on performance
• Weekly payments via Stripe or Wise

Mercor partners with leading AI labs and enterprises to train frontier AI systems using expert human knowledge.