Role Title: Generalist for Data Annotator Role Type: Contractor Location: Remote micro1 is engaging Generalists for Data Annotation to support a customer's project focused on building high-quality datasets.
AI Rater Guidelines Writer (Linguist / Instructional Designer)
United States
$45 – $65/hr
July 11, 2026
Job description
Role Overview
Join a leading AI lab's cutting-edge Generative AI team and help build the next generation of Large Language Models (LLMs).
This opportunity is designed for experienced Linguists and Instructional Designers who excel at transforming ambiguous program requirements into clear, consistent, and actionable rater guidelines. You will play a key role in improving AI training quality by creating precise evaluation instructions and rubrics used across multiple subject areas, including finance, retail, insurance, legal, and sports.
This is a W-2 employment opportunity through Cincinnatus LLC, with placement at a leading AI laboratory as part of its extended workforce.
Key Responsibilities
Develop AI Rater Guidelines
- Translate ambiguous program requirements into clear, actionable instructions for human raters.
- Design detailed evaluation guidelines that minimize ambiguity and improve consistency.
Create Evaluation Rubrics
- Build clear, comprehensive rating rubrics that handle standard scenarios and edge cases.
- Ensure guidelines remain internally consistent and free from contradictions.
Improve Existing Documentation
- Review draft guidelines for:
- Ambiguity
- Logical inconsistencies
- Coverage gaps
- Revise documentation until raters can confidently apply instructions without escalation.
Translate Domain Knowledge
Create discipline-specific guidance for projects spanning areas such as:
- Finance
- Retail
- Insurance
- Legal
- Sports
Collaborate with Cross-Functional Teams
- Work closely with researchers, program managers, and subject matter experts.
- Help maintain consistency across guideline sets and evaluation frameworks.
Required Qualifications
3+ years of professional experience in one or more of the following:
- Linguistics
- Instructional Design
- Technical Writing
- Related discipline
Direct experience creating or refining:
- AI rater guidelines
- Evaluation rubrics
- Human annotation instructions
- RLHF or GenAI documentation
Demonstrated ability to:
- Resolve ambiguity in written specifications
- Create precise, easy-to-follow documentation
- Work across multiple subject-matter domains
Strong written communication skills.
Demonstrated career progression.
Available to work at least 35 hours per week during weekdays.
Compensation
- $45–$65 per hour
Work Arrangement
- W-2 employment
- Remote within the United States
- Full-time weekday engagement (35+ hours/week)
About Cincinnatus LLC
Cincinnatus LLC partners with leading technology companies to recruit highly skilled professionals for contingent and contract opportunities.
Successful candidates are employed by Cincinnatus LLC while working directly with leading AI laboratories on high-impact artificial intelligence initiatives. Cincinnatus manages employment, payroll, benefits, onboarding, and compliance for these engagements.
Apply now
You will be redirected to the company's website to complete your application.
Join a fast-growing AI infrastructure company working with Fortune 100 clients to help build the next generation of machine learning and artificial intelligence systems. As a Document Annotation Specialist, you will annotate and classify content within PDF documents, helping…
Mercor is seeking Microsoft Word experts to work as Artifact Experts on a document conversion and refinement project supporting one of the world’s leading AI companies. This role focuses on converting, recreating, and polishing professional documents with high attention to…
About the Opportunity Join our customer's team as an AI Data Reviewer and help train next-generation AI systems through high-quality human feedback and interface analysis. In this role, you will review screenshots of software interfaces, evaluate AI-generated outputs, and…