Seeking experienced music transcribers to create accurate multi-track MIDI transcriptions and symbolic music data for training and evaluating frontier generative AI music models. This part-time remote role requires expert skills in music transcription, notation, and production software.
Music Expert — AI Evaluation & Annotation (Generative Music)
Job description
Mercor is seeking professional musicians, music producers, composers, and musicologists to evaluate and annotate AI-generated music for a frontier generative music AI laboratory.
In this role, you will complete structured music evaluation tasks that transform subjective musical quality into high-quality training data for next-generation AI systems. Your work will help improve how AI understands composition, production, vocals, musical structure, and lyrical alignment across diverse genres and languages.
Key Responsibilities
Preference Labeling
Compare AI-generated music tracks created from the same prompt and determine which performs better across evaluation criteria, including:
- Faithfulness to the prompt
- Instruction following
- Audio fidelity
- Production quality
- Vocal quality
- Musicality
Provide clear, evidence-based written rationales for every evaluation.
Music Captioning
Create structured descriptions for music tracks, including:
- Genre and style
- Instrumentation
- Song structure with timestamps
- Key and tempo
- Musical feel
- Vocal characteristics
- Production style
- Musical era
Lyric Alignment
- Produce karaoke-style word-level timestamps.
- Mark accurate start and end times for each lyric.
- Correct transcript errors such as:
- Missing words
- Repeated phrases
- Looping artifacts
- Pronunciation issues
Quality Evaluation
Apply standardized evaluation rubrics to ensure consistency, accuracy, and high-quality annotations across assigned music evaluation tasks.
Ideal Qualifications
- Professional musician, producer, composer, arranger, or musicologist.
- Strong critical listening skills across multiple musical genres and languages.
- Ability to objectively evaluate musical quality using structured rubrics.
- Excellent written communication skills for documenting evidence-based evaluations.
Preferred Qualifications
- Music production or audio mixing experience.
- Formal music theory training.
- Multilingual lyric fluency.
- Experience working across multiple musical styles and genres.
Project Details
- Remote work
- Flexible schedule
- Part-time engagement
- Short Rubric Academy calibration before project assignment
- Background check required
- Confidentiality agreement required
Projects are assigned based on your strongest musical genres and language expertise.
Compensation
- $30–$65 per hour
Contract & Payment Terms
- Independent contractor engagement
- Fully remote
- Flexible working hours
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded based on business needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.
Contributors help shape the future of generative music AI by evaluating, annotating, and improving AI-generated musical content across diverse genres and languages.
You will be redirected to the company's website to complete your application.