Help train next-generation AI systems by translating, editing, analyzing, and evaluating Kurdish-language content while providing cultural and linguistic expertise across multilingual AI projects.
AI Quality Analyst (Gemini) - Chinese
Job description
About Turing
Based in San Francisco, California, Turing is a leading research accelerator supporting frontier AI laboratories and enterprises deploying advanced AI systems.
Turing helps organizations improve AI performance through high-quality datasets, advanced training pipelines, model evaluation, multilingual expertise, reasoning tasks, and agent-based systems.
Role Overview
As an AI Quality Analyst, you will evaluate a new personalization feature for Gemini.
The role involves assessing how effectively the model uses information from previous Gemini conversations, Gmail activity, Google Search history, and YouTube activity to produce more relevant and helpful responses.
This position combines creative prompt design with detailed AI quality evaluation and analysis.
Key Responsibilities
Prompt Design and Testing
- Design multi-turn conversations (typically 1-5 turns)
- Create prompts based on personal experiences and context
- Test how effectively Gemini uses personalization signals
Response Evaluation
- Evaluate AI responses for grounding, integration, helpfulness, accuracy, and naturalness
- Identify incorrect personalization, poor inferences, hallucinations, and forced connections
Side-by-Side (SxS) Evaluation
- Compare two model responses
- Rank responses based on usefulness, ease of use, and overall quality
- Identify subtle differences in tone, relevance, over-narration, and user experience
Documentation and Feedback
- Write structured rationales explaining model rankings
- Reference specific conversation turns when providing feedback
- Verify debug information and data-source usage
- Maintain evaluation data hygiene by removing evaluation conversations when required
Required Qualifications
- Strong ability to read and write Chinese
- Excellent written communication skills
- Strong analytical and evaluation abilities
- Attention to detail
- Ability to provide detailed annotations and constructive feedback
Preferred Experience
- Data annotation, AI quality evaluation, content moderation, AI training, or related analytical work
Education and Background
Bachelor's degree or equivalent experience in fields such as Computer Science, Linguistics, Journalism, Policy, Law, Ethics, or related analytical disciplines.
Engagement Details
- Contractor engagement
- 3-month project duration
- Minimum 4 hours per day, up to 40 hours per week
- Requires at least 4 hours overlap with PST working hours
Compensation
- $15/hour
Hiring Process
- Complete a Job Interest Form
- Profile review
- Complete an assessment within 24 hours
- Selected candidates proceed to pre-onboarding discussions
You will be redirected to the company's website to complete your application.