Seeking PhD-level experts in automated planning, symbolic AI, machine learning, operations research, and related fields to create advanced reasoning challenges for frontier AI training and evaluation projects.
Automated CS Planning QA Reviewers — Zion (Arches)
Job description
Mercor is seeking Automated CS Planning QA Reviewers for a premier project with one of the world's leading AI laboratories.
In this role, you will review and quality-check advanced symbolic AI and automated planning problems created by domain experts. Your work will help ensure the correctness, technical rigor, and clarity of datasets used to train and evaluate frontier AI systems.
Each problem receives multiple independent reviews to maintain the highest standards of quality and accuracy.
Responsibilities
Review advanced automated planning and symbolic AI problems
Verify:
- Technical correctness
- Logical consistency
- Solution validity
- Clarity of presentation
Review associated solutions and reasoning
Identify:
- Technical errors
- Incomplete reasoning
- Ambiguous problem statements
- Incorrect conclusions
Ensure problems meet high standards of:
- Technical rigor
- Educational value
- Domain accuracy
Provide detailed quality assurance feedback
Collaborate with reviewers and project teams to maintain consistency across datasets
Required Qualifications
Candidates should possess a PhD, advanced degree, or equivalent research experience in one or more of the following fields:
- Computer Science
- Artificial Intelligence
- Machine Learning
- Operations Research
Preferred Specialization
- Automated Planning
- Symbolic AI
- Knowledge Representation
- Search Algorithms
- AI Planning Systems
- Decision Making Systems
Additional Requirements
- Strong reviewing and quality assurance skills
- Ability to rigorously validate technical problems and solutions
- Exceptional attention to detail
- Strong analytical thinking
- Excellent written communication skills
- Excellent verbal communication skills
Screening Process
- Complete a short interview
- Complete a project-related assessment
The combined onboarding process typically takes approximately 20–30 minutes.
Paid Onboarding
Successful candidates will be compensated for:
- Screening activities
- Onboarding tasks
- Required onboarding videos
up to one hour of onboarding time.
Location Requirements
Applicants must be located in one of the following countries:
- United States
- United Kingdom
- Canada
- Australia
- New Zealand
Compensation
- $55–80/hour
- Weekly payments through Stripe or Wise
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work
- Flexible schedule
- Weekly payments through Stripe or Wise
- Projects may be extended, shortened, or concluded based on business needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.
Contributors collaborate with researchers and domain experts on projects shaping the future of artificial intelligence and advanced reasoning systems.
You will be redirected to the company's website to complete your application.