Remote contractor opportunity for experienced quality assurance professionals to oversee AI training quality, evaluate trainer and QA work, maintain documentation, support onboarding, and ensure consistent adherence to project standards across distributed teams.
Odia (Oriya) Quality Assurance Lead (QAL)
Job description
About the Role
This is a remote, hourly contractor role for a Odia Quality Assurance Lead (QAL) responsible for overseeing quality, consistency, and contributor performance across Odia AI training projects.
You will review AI-generated Odia content as well as trainer and QA work, evaluate outputs against project guidelines and rubrics, provide actionable feedback, maintain quality documentation, support onboarding, and ensure contributors consistently meet project standards.
Your work will directly impact the quality of Odia-language training data used by leading AI companies and foundation-model laboratories.
Key Responsibilities
Quality Monitoring
- Review Odia-language submissions and conduct spot checks
- Identify quality issues, recurring errors, and guideline violations
- Provide clear and actionable feedback to contributors
- Escalate critical or repeated quality concerns
Trainer & QA Communication
- Communicate project updates and workflow changes
- Share new guidelines and quality expectations
- Ensure trainers and QAs remain aligned with project requirements
Question Handling
- Respond to contributor questions promptly
- Clarify instructions, translation requirements, linguistic edge cases, cultural nuances, and Odia language standards
- Help contributors understand project expectations and quality standards
Contributor Activation Management
- Follow up with inactive contributors
- Encourage participation and activation
- Track contributor engagement and availability
- Escalate staffing or participation concerns when necessary
Documentation Management
- Create and maintain Odia style guides, FAQs, trackers, quality notes, example libraries, honeypots, and onboarding materials
- Ensure documentation remains accurate and current
Onboarding & Training
- Conduct onboarding sessions for trainers and QAs
- Explain workflows, rubrics, quality standards, and Odia language requirements
- Support continuous learning and quality improvement
Quality Alignment
- Ensure consistent application of Odia language guidelines
- Monitor compliance with evolving requirements
- Promote standardization across contributors and teams
Process Improvement
- Identify recurring quality gaps and recommend workflow enhancements
- Help develop scalable QA systems and best practices for Odia-language projects
Required Skills & Qualifications
- Native or near-native Odia proficiency and strong professional English proficiency
- 3+ years of professional experience in Odia writing, editing, translation, localization, content QA, AI training, education, annotation, or related language-review workflows
- Strong understanding of Odia grammar, spelling conventions, punctuation, tone, register, and cultural context
- Ability to identify mistranslations, literal phrasing, unnatural language, hallucinated claims, ambiguity, and terminology inconsistencies
- Ability to evaluate work against detailed rubrics and guidelines
- Strong written communication, feedback, and organizational skills
Preferred Qualifications
- Experience leading or supporting trainers, annotators, editors, reviewers, or QA teams
- Experience with AI training, data annotation, LLM evaluation, prompt/response evaluation, and rubric-based QA
- Familiarity with Discord, Google Docs, Google Sheets, dashboards, and project management systems
Additional Information
- Fully remote work
- Flexible schedule
- Weekly payments
- Access to future opportunities through the SME Careers expert network
About SME Careers
SME Careers is an AI data services company and subsidiary of SuperAnnotate that provides training data for many of the world's leading AI companies and foundation-model laboratories.
You will be redirected to the company's website to complete your application.