Role Overview
Welocalize (Welo Data) is seeking a detail-oriented AI Data Quality Specialist to support the development and evaluation of large language models (LLMs).
In this role, you will review English-language content and assess sentiment accuracy, factual consistency, and reasoning quality using structured guidelines. This is an ideal opportunity for individuals with strong analytical skills and attention to detail who are interested in AI data work.
What You Will Do
- Review and label content for sentiment, factual accuracy, and reasoning issues.
- Evaluate AI-generated outputs using structured scoring frameworks.
- Validate automated assessments and identify discrepancies or errors.
- Provide clear, well-reasoned written justifications for evaluations.
- Maintain consistency and accuracy across large volumes of tasks.
Requirements
- Advanced English proficiency (professional-level reading and writing).
- Strong comprehension and ability to articulate clear written feedback.
- Previous experience in data annotation, AI training, or similar work.
- Strong analytical reasoning and critical thinking skills.
- Exceptional attention to detail and consistency in decision-making.
- Ability to follow structured guidelines and evaluation frameworks.
Preferred Qualifications
- Background in linguistics, journalism, research, or related analytical fields.
- Familiarity with AI systems, large language models (LLMs), or evaluation workflows (preferred but not required).
Compensation
- Hourly Pay: $4.50 per hour
Additional Details
- Contract Type: Freelance
- Location: Philippines (remote)
- Work involves high-volume, guideline-based evaluation tasks.
Hiring Process Note
Welocalize may use AI tools to assist with application review and assessment, but all final hiring decisions are made by human recruiters.