We are looking for detail oriented analysts to evaluate and rank AI generated responses to text based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning…
Personal Account Rater - English
Job description
Role Overview
Turing is seeking Personal Account Raters (English) to evaluate personalized AI interactions for professional users. In this remote contractor role, you will assess how effectively AI leverages business email history from your primary Google Workspace account to generate relevant, accurate, and personalized responses. Your evaluations will directly contribute to improving next-generation AI systems.
This opportunity is ideal for professionals with strong analytical thinking, attention to detail, and excellent written communication skills.
Key Responsibilities
Evaluate AI Responses
Review AI-generated responses based on your professional email history and business account activity.
Assess whether responses are:
- Relevant
- Accurate
- Helpful
- Appropriately personalized
Compare multiple AI-generated responses and determine which provides the best overall user experience.
Analyze Personalization Quality
Identify issues such as:
- Incorrect personalization
- Unsupported assumptions
- Irrelevant recommendations
- Missing context
Evaluate how effectively AI retrieves and uses information from your business account.
Provide Structured Feedback
- Write detailed, objective evaluations explaining the strengths and weaknesses of AI-generated responses.
- Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
- Help improve AI personalization and response quality through actionable feedback.
Maintain Privacy & Compliance
- Use your primary Google Workspace account for project evaluations.
- Complete all required consent forms before participation.
- Maintain confidentiality and comply with all project privacy requirements.
Required Qualifications
Native-level proficiency in English (US).
Active Google Workspace account used regularly for professional communication.
Gmail display language set to English.
Business inbox containing approximately 1,000 or more emails with regular activity.
Willingness to use your primary business account and complete the required consent process.
Strong analytical thinking and attention to detail.
Excellent written communication skills.
Ability to work independently in a remote environment.
Desktop or laptop with a reliable internet connection.
Preferred Qualifications
Bachelor's degree or equivalent practical experience.
Experience in:
- AI Evaluation
- Data Annotation
- Content Review
- Quality Assurance
- Other analytical roles
Compensation
- Competitive compensation (not specified)
Work Arrangement
- Fully Remote
- Independent Contractor
- Minimum 4 hours per day
- Up to 40 hours per week
- 3–4 month engagement
- Requires 4 hours of overlap with Pacific Time (PST)
Opens work.turing.com in a new tab. If they ask how you found the role, mention RemoWork.