QA Specialist - Audio Annotation & Diarization (US English)

About Turing

Turing is a leading AI research acceleration company partnering with frontier AI labs and enterprises to develop advanced AI systems.

Turing supports AI innovation through high-quality datasets, training pipelines, multilingual reasoning systems, multimodal AI workflows, and human-in-the-loop evaluation programs.

---

Role Overview

Turing is seeking QA Specialists for a high-impact Audio Annotation & Diarization project focused on evaluation-grade multilingual and multi-speaker AI systems.

In this role, you will serve as the final quality assurance layer for audio recordings, transcriptions, diarization outputs, timestamps, metadata, and annotation integrity.

This role is ideal for professionals with exceptional audio analysis skills, transcription accuracy, linguistic expertise, or speech annotation experience.

---

Project Workflow

• Contributors record unscripted group conversations
• AI systems generate initial transcription and diarization outputs
• Human annotators validate and correct the outputs
• QA Specialists perform final review and approval of the full dataset

---

Key Responsibilities

Audio Quality Assurance

• Review multi-channel audio recordings for technical quality
• Detect background noise, clipping, low gain, and channel bleed
• Verify clean recording environments and channel isolation
• Ensure recordings meet strict fidelity requirements

Transcription & Diarization Verification

• Review human-validated transcripts for extremely high accuracy
• Validate speaker diarization and conversational flow
• Confirm word-level and turn-level timestamps
• Ensure natural conversational dynamics are preserved, including:
• Overlaps
• Interruptions
• False starts
• Backchannels
• Disfluencies

Metadata & Content Review

• Validate metadata tagging accuracy
• Review contextual and demographic labeling
• Ensure compliance with privacy and safety standards
• Detect and flag PII or sensitive content
• Verify JSON-formatted annotation structures and timestamp logic

Reporting & Quality Control

• Assign pass/fail or agree/disagree review outcomes
• Provide actionable QA feedback to annotators
• Document quality issues and correction requirements
• Maintain strict dataset consistency standards

---

Required Skills & Qualifications

• Native proficiency in US English
• Exceptional attention to detail
• Strong ability to assess multi-speaker conversations
• Excellent listening and audio fidelity evaluation skills
• Ability to detect:
• Audio bleed
• Noise contamination
• Clipping
• Timestamp inconsistencies
• Metadata errors

Strong familiarity with:

• Audio QA workflows
• Verbatim transcription standards
• Speaker diarization
• Timestamp validation
• Conversational speech analysis
• JSON-based annotation review

---

Ideal Backgrounds

Linguists / Phonetics Experts

• Expertise in spontaneous speech analysis
• Understanding of conversational overlaps and speech dynamics

Language Teachers

• Strong mastery of spoken US English
• Experience following strict verbatim transcription rules

Professional Transcriptionists

• High-accuracy transcription experience
• Audio fidelity analysis expertise
• Word-level timestamping experience

---

Work Details

• Fully remote contractor assignment
• Minimum 40 hours/week
• At least 4 hours/day overlap with PST required
• Contract duration: 15 weeks
• Potential contract extension based on performance

---

Why Join Turing

• Work on frontier AI speech systems
• Contribute to multilingual conversational AI research
• Collaborate with leading AI labs
• Flexible remote work environment
• High-impact role in AI data quality assurance