We are looking for detail oriented analysts to evaluate and rank AI generated responses to text based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning…
Business Account Rater - Portuguese (BR)
Job description
Role Overview
Turing is seeking Business Account Raters (Portuguese – Brazil) to evaluate personalized AI interactions for professional users. In this remote contractor role, you will assess how effectively AI leverages information from your primary Google Workspace (Corporate Gmail) account to generate relevant, accurate, and personalized responses in Portuguese. Your evaluations will directly contribute to improving next-generation AI systems.
This opportunity is ideal for Brazilian Portuguese-speaking professionals with strong analytical thinking, attention to detail, and excellent written communication skills who regularly use Google Workspace for business communication.
Key Responsibilities
Evaluate AI Responses
Review AI-generated responses based on your professional email history and business account activity.
Assess whether responses are:
- Relevant
- Accurate
- Helpful
- Appropriately personalized
Compare multiple AI-generated responses and determine which provides the best overall user experience.
Analyze Personalization Quality
Identify issues such as:
- Incorrect personalization
- Unsupported assumptions
- Irrelevant recommendations
- Missing context
Evaluate how effectively AI retrieves and uses information from your corporate Google Workspace account.
Provide Structured Feedback
- Write detailed, objective evaluations explaining the strengths and weaknesses of AI-generated responses.
- Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
- Help improve AI personalization and response quality through actionable feedback.
Maintain Privacy & Compliance
- Use your primary Google Workspace (Corporate Gmail) account for project evaluations.
- Complete all required consent forms before participation.
- Maintain confidentiality and comply with all project privacy requirements.
Required Qualifications
Native-level proficiency in Portuguese (Brazil).
Must currently reside outside the United States.
Active Google Workspace (Corporate Gmail) account used regularly for professional communication.
Gmail display language set to Portuguese.
Business inbox containing approximately 1,000 or more emails with regular activity.
Majority of business emails must be in Portuguese.
Willingness to use your primary business account and complete the required consent process.
Strong analytical thinking and attention to detail.
Excellent written communication skills.
Ability to work independently in a remote environment.
Desktop or laptop with a reliable internet connection.
Preferred Qualifications
Bachelor's degree or equivalent practical experience.
Experience in:
- AI Evaluation
- Data Annotation
- Content Review
- Quality Assurance
- Other analytical roles
Compensation
- Competitive compensation (not specified)
Work Arrangement
- Fully Remote
- Independent Contractor
- Minimum 4 hours per day
- Up to 40 hours per week
- 3–4 month engagement
- Requires 4 hours of overlap with Pacific Time (PST)
Opens work.turing.com in a new tab. If they ask how you found the role, mention RemoWork.