Seeking experienced Machine Learning Engineers and Applied ML Researchers to design, evaluate, and solve complex machine learning challenges while helping improve next-generation AI systems.
Software / AI / IT / Data Evaluator
Remote (Global)
$80 – $120/hr
June 6, 2026
Job description
About the Role
Mercor is seeking experienced Software, AI, IT, and Data Evaluators to assess AI-generated work products for accuracy, rigor, presentation quality, and domain expertise.
Evaluators will review materials such as:
- Technical documentation
- System architecture proposals
- Data analysis reports
- AI and machine learning deliverables
- IT operations documents
- Spreadsheets
- Slide presentations
The role focuses on applying professional software engineering, AI, IT, and data expertise to grade and provide feedback on AI-generated outputs using structured evaluation criteria.
This is a fully remote, hourly contract opportunity.
What You'll Do
- Evaluate AI-generated artifacts using domain-specific quality rubrics
- Review outputs for:
- Technical accuracy
- Analytical rigor
- Architectural soundness
- Presentation quality
- Identify:
- Technical errors
- Data inaccuracies
- Logical inconsistencies
- Aesthetic issues
- Presentation deficiencies
- Assess the quality of:
- Software designs
- AI and machine learning analyses
- Data workflows
- IT strategies
- Technical recommendations
- Provide clear, structured written feedback
- Apply professional judgment to assess overall output quality and usefulness
Required Qualifications
- 5+ years of professional experience in one or more of:
- Software Engineering
- Artificial Intelligence
- Data Science
- Data Engineering
- Information Technology
- Machine Learning
- Cloud Infrastructure
- Technical Architecture
- Native or professional fluency in English
- Strong proficiency with:
- Microsoft Office
- Google Workspace
Presentation Software Experience
Candidates should be highly comfortable using:
- Google Slides
- Microsoft PowerPoint
Preferred Qualifications
- Master's degree or higher
- Advanced academic credentials from a reputable institution
- Additional expertise in:
- Machine Learning
- Data Analytics
- Cloud Computing
- Cybersecurity
- Software Architecture
- Generative AI
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work
- Flexible schedule
- Weekly payments through Stripe or Wise
- Projects may be extended, shortened, or concluded based on business needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and evaluate frontier AI systems using human expertise.
Contributors work on projects that help improve AI performance across specialized professional domains through expert review and evaluation.
Apply now
You will be redirected to the company's website to complete your application.
AI & Machine Learning Engineer - AI Training About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human data in the world.
AI & Machine Learning Engineer - AI Training About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human data in the world.
AI & Machine Learning Engineer - AI Training About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human data in the world.