Audio Transcriber - Audio Annotation & Diarization (US English)

About Turing

Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.

Role Overview

We are building a highly accurate, evaluation-grade dataset of transcribed, multi-channel audio recordings to assess multilingual, multi-speaker AI systems. This project involves evaluating high-quality, realistic conversations representing diverse dynamics, contexts, and demographics.

The Workflow

Contributors record unscripted group conversations. These recordings are run through an initial transcription and diarization pass, which contributors then human-validate and correct. As a QA Specialist, you are the final line of defense, responsible for reviewing the end-to-end quality of both the audio recordings and the human-verified annotations.

Key Responsibilities

Audio quality assurance

• Evaluate multi-channel audio recordings to ensure they meet strict technical and fidelity requirements.
• Verify channel isolation (no audio bleed) and confirm recordings were captured in appropriate, quiet environments free from disruptive background noise, clipping, or low gain.

Transcription and diarization verification

• Review human-validated transcriptions to guarantee exceptionally high accuracy and adherence to strict word-error-rate targets.
• Confirm transcripts correctly capture spontaneous, unnormalized speech, preserving natural conversational dynamics such as overlaps, interruptions, and false starts.
• Validate the precision of turn-level and word-level timestamps and speaker identification, paying special attention to complex overlapping dialogue, while reading and validating the underlying JSON-formatted data for accurate metadata tagging and timestamp logic.

Metadata and content review

• Verify the accuracy of all applied metadata, including demographic markers, contextual domains, and conversational tags.
• Enforce strict safety and privacy standards by auditing sessions to ensure no personally identifying information, toxic, or sensitive content is present.

Execution and reporting

• Assess the end-to-end quality of the annotation task, assigning clear pass/fail statuses during review.
• Provide detailed, actionable comments and feedback whenever disagreeing with an annotator's work.

Requirements & Qualifications

• Exceptional ear for audio fidelity and the ability to detect subtle background noises, channel bleed, or clipping.
• Meticulous attention to detail for verifying word-level timestamps and strict, unnormalized verbatim transcription rules.
• Native proficiency in US English.
• Ability to accurately assess complex multi-speaker dynamics.

Ideal Backgrounds

• Linguists and phonetics experts: deep understanding of natural, unnormalized speech patterns, and expertise in annotating complex conversational dynamics including overlaps, false starts, and backchannels.
• Language teachers: native-level mastery of the target language and the ability to strictly adhere to verbatim transcription guidelines, documenting every stutter, filler word, and disfluency without applying prescriptive grammar corrections.
• Professional transcriptionists: ear for audio fidelity, rigorous timestamping skills, and experience meeting strict accuracy targets.

Offer Details

• Engagement type: contractor assignment / freelancer (no medical or paid leave).
• Duration of contract: 8 weeks.

Evaluation Process

Shortlisted candidates will be reviewed by the team internally and will be reached out to for onboarding.