Create and evaluate advanced math prompts to test AI reasoning. Remote, flexible work with pay up to $60/hour.
Analyst
Job description
About the Role
DataAnnotation is hiring Analysts to help train and improve advanced AI systems through mathematical reasoning and problem evaluation.
In this role, you will create complex mathematics problems, evaluate AI-generated responses, and help improve the logical reasoning and performance of AI models.
This is a flexible remote contractor opportunity open to applicants across the United States.
Key Responsibilities
Mathematical AI Evaluation
- Create diverse and complex mathematics problems for AI systems
- Evaluate AI-generated solutions for:
- Correctness
- Logical reasoning
- Accuracy
- Performance
- Analyze mathematical outputs and identify reasoning flaws
Problem Solving & Review
- Assess AI responses across:
- Arithmetic
- Algebra
- Geometry
- Calculus
- Probability
- Statistics
- Review step-by-step reasoning quality
- Help improve model reasoning consistency and reliability
AI Training Support
- Provide structured feedback on AI outputs
- Support AI model improvement through evaluation workflows
- Maintain high standards for mathematical precision and annotation quality
Required Qualifications
- Native or bilingual English fluency
- Strong mathematical reasoning ability
- Proficiency in:
- Arithmetic
- Algebra
- Geometry
- Calculus
- Probability
- Statistics
- Inductive and deductive reasoning
- High attention to detail
- Ability to work independently
Preferred Qualifications
- Background in:
- Applied Mathematics
- Mathematics
- Computer Science
- Statistics
- Quantitative research
- Master’s or PhD degree:
- Completed
- In progress
- Or equivalent expertise
- Familiarity with:
- AI systems
- LLM evaluation
- Analytical workflows
Benefits
- Fully remote
- Flexible work schedule
- Choose projects independently
- Full-time or part-time opportunities
- Hourly compensation starting at $40+/hr
- Performance bonuses available
Payment & Eligibility
- Payment handled through PayPal
- Open only to applicants located in the United States
- Independent contractor role
About DataAnnotation
DataAnnotation provides human evaluation and feedback systems used to train advanced AI and generative language models.
You will be redirected to the company's website to complete your application.