Back to remote jobs

Music Expert — AI Evaluation & Annotation (Generative Music)

Mercor

AI Expert - Music & Audio Freelancer · Part-time Short-term
Remote (Global) $30 – $65/hr July 2, 2026

Job description

Mercor is seeking professional musicians, music producers, composers, and musicologists to evaluate and annotate AI-generated music for a frontier generative music AI laboratory.

In this role, you will complete structured music evaluation tasks that transform subjective musical quality into high-quality training data for next-generation AI systems. Your work will help improve how AI understands composition, production, vocals, musical structure, and lyrical alignment across diverse genres and languages.

Key Responsibilities

Preference Labeling

Compare AI-generated music tracks created from the same prompt and determine which performs better across evaluation criteria, including:

  • Faithfulness to the prompt
  • Instruction following
  • Audio fidelity
  • Production quality
  • Vocal quality
  • Musicality

Provide clear, evidence-based written rationales for every evaluation.

Music Captioning

Create structured descriptions for music tracks, including:

  • Genre and style
  • Instrumentation
  • Song structure with timestamps
  • Key and tempo
  • Musical feel
  • Vocal characteristics
  • Production style
  • Musical era

Lyric Alignment

  • Produce karaoke-style word-level timestamps.
  • Mark accurate start and end times for each lyric.
  • Correct transcript errors such as:
    • Missing words
    • Repeated phrases
    • Looping artifacts
    • Pronunciation issues

Quality Evaluation

Apply standardized evaluation rubrics to ensure consistency, accuracy, and high-quality annotations across assigned music evaluation tasks.

Ideal Qualifications

  • Professional musician, producer, composer, arranger, or musicologist.
  • Strong critical listening skills across multiple musical genres and languages.
  • Ability to objectively evaluate musical quality using structured rubrics.
  • Excellent written communication skills for documenting evidence-based evaluations.

Preferred Qualifications

  • Music production or audio mixing experience.
  • Formal music theory training.
  • Multilingual lyric fluency.
  • Experience working across multiple musical styles and genres.

Project Details

  • Remote work
  • Flexible schedule
  • Part-time engagement
  • Short Rubric Academy calibration before project assignment
  • Background check required
  • Confidentiality agreement required

Projects are assigned based on your strongest musical genres and language expertise.

Compensation

  • $30–$65 per hour

Contract & Payment Terms

  • Independent contractor engagement
  • Fully remote
  • Flexible working hours
  • Weekly payments via Stripe or Wise
  • Projects may be extended, shortened, or concluded based on business needs and performance

Important Note

Mercor currently cannot support:

  • H1-B candidates
  • STEM OPT candidates

About Mercor

Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.

Contributors help shape the future of generative music AI by evaluating, annotating, and improving AI-generated musical content across diverse genres and languages.

Apply now

You will be redirected to the company's website to complete your application.

Apply now

Stay in the loop.

One email per week, 5 hand-picked roles.