Mercor is seeking Automated CS Planning QA Reviewers for a premier project with one of the world's leading AI laboratories. In this role, you will review and quality-check advanced symbolic AI and automated planning problems created by domain experts. Your work will help ensure…
Machine Learning & NLP Expert
United States
$80 – $110/hr
July 2, 2026
Job description
Join a leading AI laboratory's cutting-edge Generative AI team and help develop the next generation of machine learning and natural language processing models.
A leading AI lab is seeking experienced Machine Learning and NLP professionals to serve as subject matter experts for training and evaluating frontier AI systems. In this role, you will create challenging real-world ML and NLP tasks, develop expert reference solutions, and evaluate AI-generated outputs to identify reasoning gaps and model limitations.
This is a part-time W-2 employment opportunity with Cincinnatus LLC. Selected candidates may be placed with a leading AI laboratory as part of its extended workforce. The role is fully remote within the United States with an expected commitment of approximately 20 hours per week.
Key Responsibilities
Design ML & NLP Tasks
Create challenging, real-world machine learning and natural language processing problems covering areas such as:
- Model training and evaluation
- Language understanding and generation
- Retrieval systems
- Applied machine learning pipelines
- Large Language Models (LLMs)
Develop Expert Reference Solutions
Implement problems within an agentic development environment using Python and prepare complete, executable reference solutions where appropriate.
Evaluate AI Models
Assess model performance against expert-designed tasks, identifying:
- Correctness
- Reasoning quality
- Capability limitations
- Failure modes
Identify Capability Gaps
Analyze model failures and classify reasoning errors to help improve future AI systems.
Collaborate with Experts
Work alongside other machine learning and NLP specialists to maintain high-quality evaluation standards and consistent task design.
Ideal Qualifications
- Strong hands-on experience in Machine Learning and/or Natural Language Processing gained through industry, research, or graduate-level study.
- Professional proficiency in Python.
- Deep understanding of modern ML and NLP techniques.
Technical Expertise
Experience with:
- Machine Learning
- Natural Language Processing
- Transformer architectures
- Large Language Models (LLMs)
- Model training and evaluation
- Python development
- Applied AI workflows
Preferred Qualifications
- Experience with AI training or model evaluation.
- Data annotation experience.
- Strong written communication skills.
- Ability to work independently in a remote environment.
Compensation
- $80–$110 per hour
Employment Details
- Part-time W-2 employment
- Approximately 20 hours per week
- Fully remote within the United States
- Employer of Record: Cincinnatus LLC
Unlike freelance or project-based work, this is a structured employment opportunity that includes close collaboration with client teams and integration into enterprise workflows.
About Cincinnatus LLC
Cincinnatus LLC partners with leading technology companies to recruit and employ highly skilled professionals for contingent workforce opportunities.
The company serves as the Employer of Record, providing payroll, benefits, compliance, and employment administration while employees work directly with client organizations on high-impact AI initiatives.
Cincinnatus is committed to equal employment opportunity and provides reasonable accommodations throughout the hiring process.
Apply now
You will be redirected to the company's website to complete your application.
Mercor is seeking Automated CS Planning PhDs and Domain Experts for a premier project with one of the world's leading AI laboratories. In this role, you will apply advanced expertise in automated planning, symbolic AI, artificial intelligence, machine learning, and related…
Senior Software Engineer (AI Systems) About the Role What if your engineering expertise could power the AI systems that are transforming how millions of people work, learn, and communicate every day? We're looking for a Senior Software Engineer to design, build, and scale the…
Join a leading AI lab's cutting-edge Generative AI team and help build foundational AI models from the ground up. This opportunity is seeking experienced MLOps Engineers with deep expertise in JAX and kernel-level programming using Pallas or Triton. The role focuses on AI…