Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.
Personal Account Generalist Raters (US)
Job description
Role Overview
Turing is seeking US-based Personal Account Generalist Raters to evaluate personalized AI interactions powered by Gemini. In this remote contractor role, you will assess how effectively AI retrieves information from connected Google applications, evaluate response quality, and provide structured feedback that helps improve personalization capabilities across Google's ecosystem.
This opportunity is ideal for individuals with strong analytical thinking, attention to detail, and experience using Google Workspace or Google consumer applications.
Key Responsibilities
Evaluate Personalized AI Responses
Review AI-generated responses based on data retrieved from connected Google applications.
Assess whether responses are:
- Relevant
- Accurate
- Helpful
- Appropriately personalized
Compare multiple AI-generated responses and determine which delivers the best user experience.
Analyze Personalization Quality
- Evaluate AI performance using your professional email history and business account activity.
- Identify issues such as:
- Incorrect personalization
- Unsupported assumptions
- Irrelevant recommendations
- Missing or incomplete context
Provide Structured Feedback
- Write detailed, objective evaluations explaining response strengths and weaknesses.
- Follow project guidelines to ensure consistent, high-quality ratings.
- Help improve AI personalization and context retrieval capabilities.
Maintain Compliance
- Connect eligible Google applications (such as Gmail, Google Calendar, Google Drive, and Google Photos) to Gemini for evaluation purposes.
- Maintain confidentiality and follow all privacy, consent, and project requirements.
- Work independently while meeting productivity and quality expectations.
Required Qualifications
Currently based in the United States.
Willing and able to connect Google applications to Gemini, including services such as:
- Gmail
- Google Calendar
- Google Drive
- Google Photos
Active use of Google Workspace or Google consumer applications with sufficient personal account history.
Strong analytical thinking and attention to detail.
Excellent written communication skills.
Ability to work independently in a remote environment.
Desktop or laptop with a reliable internet connection.
Preferred Qualifications
Bachelor's degree or equivalent practical experience.
Experience in:
- AI Evaluation
- Data Annotation
- Content Review
- Quality Assurance
- Other analytical roles
Compensation
- Competitive compensation (not specified)
Work Arrangement
- Fully Remote
- Independent Contractor
- Up to 40 hours per week
- Minimum 4 hours per day
- Up to 4-month engagement
- Requires 4 hours of overlap with Pacific Time (PST)
Opens work.turing.com in a new tab. If they ask how you found the role, mention RemoWork.