Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.
Audio Evaluations: JSON & Coding Expert (Multiple Languages)
United States, Albania, Algeria +142
$25/hr
May 27, 2026
Job description
About the opportunity
We are sourcing independent contractor experts to evaluate AI-generated technical and customer-facing outputs. The work combines language fluency, customer service judgment, and coding knowledge, with a focus on JSON structure, formatting accuracy, and response quality.
What you will do
- Review responses for clarity, helpfulness, natural language, and technical accuracy.
- Read and validate JSON, identify structural or formatting issues, and assess outputs against project guidelines.
- Apply careful attention to detail and clear written communication when evaluating responses.
Languages currently sourcing
We are currently sourcing Dutch (Netherlands), Welsh, French (Canada), German (Germany), Italian (Italy), Portuguese (Brazil), and Greek. Select the cohort that matches your language fluency.
Assessments
You will complete a language fluency introduction and a JSON Skills Assessment. The introduction includes two recorded speaking responses: one in English and one in the language of your selected cohort, covering your professional background and experience with JSON. Each response allows up to two minutes, within an eight-minute assessment.
Please speak naturally and in your own words rather than reading a prepared script.
Compensation by region
Pay varies by where you're based. Each region below is open to applicants in that country only.
Country
States / regions
Pay range
Apply
Apply now
Opens marketplace.inv.tech in a new tab. If they ask how you found the role, mention RemoWork.
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly…
Help shape the future of AI by evaluating the technical accuracy, language quality, and usefulness of AI-generated responses.
Role Title: Research Engineer - Code Generation & Model Evaluation Role Type: Contractor Location: Remote micro1 is engaging Research Engineers to participate in a project focused on code generation and model evaluation for a customer's initiative.