We are looking for detail oriented analysts to evaluate and rank AI generated responses to text based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning…
Business Account Rater - Bilingual (KO, DE, FR)
Job description
Role Overview
Turing is seeking Business Account Raters (Bilingual – Korean, German, or French) to evaluate personalized AI interactions for professional users. In this remote contractor role, you will assess how effectively AI leverages information from your primary Google Workspace (Corporate Gmail) account to generate relevant, accurate, and personalized responses across both your native language and English.
This opportunity is ideal for bilingual professionals with strong analytical thinking, attention to detail, and excellent written communication skills who regularly use Google Workspace for business communication.
Key Responsibilities
Evaluate AI Responses
Review AI-generated responses based on your professional email history and business account activity.
Assess whether responses are:
- Relevant
- Accurate
- Helpful
- Appropriately personalized
Compare multiple AI-generated responses and determine which provides the best overall user experience.
Analyze Personalization Quality
Identify issues such as:
- Incorrect personalization
- Unsupported assumptions
- Irrelevant recommendations
- Missing context
Evaluate how effectively AI retrieves and uses information from your corporate Google Workspace account across bilingual email content.
Provide Structured Feedback
- Write detailed, objective evaluations explaining the strengths and weaknesses of AI-generated responses.
- Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
- Help improve AI personalization and response quality through actionable feedback.
Maintain Privacy & Compliance
- Use your primary Google Workspace (Corporate Gmail) account for project evaluations.
- Complete all required consent forms before participation.
- Maintain confidentiality and comply with all project privacy requirements.
Required Qualifications
Native-level proficiency in one of:
- Korean
- German
- French
Strong professional proficiency in English.
Must currently reside outside the United States.
Active Google Workspace (Corporate Gmail) account used regularly for professional communication.
Business inbox containing approximately 1,000 or more emails with regular activity.
Business inbox must contain both your native language and English emails, with each representing at least 30% of inbox content.
Gmail display language set to the target project language.
Willingness to use your primary business account and complete the required consent process.
Strong analytical thinking and attention to detail.
Excellent written communication skills.
Ability to work independently in a remote environment.
Desktop or laptop with a reliable internet connection.
Preferred Qualifications
Bachelor's degree or equivalent practical experience.
Experience in:
- AI Evaluation
- Data Annotation
- Content Review
- Quality Assurance
- Other analytical roles
Compensation
- Competitive compensation (not specified)
Work Arrangement
- Fully Remote
- Independent Contractor
- Minimum 4 hours per day
- Up to 40 hours per week
- 3–4 month engagement
- Requires 4 hours of overlap with Pacific Time (PST)
Opens work.turing.com in a new tab. If they ask how you found the role, mention RemoWork.