Remote Generalist Expert role designing everyday workflows and evaluating AI systems across personal tasks and decision-making.
Generalist Expert
Job description
Oerview
Mercor is seeking Generalist Experts to evaluate AI-generated responses and provide structured written feedback that helps improve frontier AI systems.
This role is ideal for analytical thinkers with strong reasoning and communication skills who can assess complex responses, identify weaknesses in logic or evidence, and apply evaluation guidelines consistently.
Responsibilities
Evaluate AI-generated responses across a variety of topics
Provide structured written feedback and rationales
Identify:
- Gaps in reasoning
- Unsupported claims
- Missing context
- Nuanced issues in responses
Apply detailed evaluation guidelines consistently
Deliver objective and evidence-based assessments
Contribute to AI training and evaluation projects used by leading AI labs
Basic Qualifications
- Bachelor's degree from a top-500 globally ranked university preferred
- Strong analytical skills
- Strong written communication skills
- Ability to work independently
- Ability to follow detailed instructions and evaluation frameworks
Required Skills
Strong critical reading abilities
Ability to identify:
- Nuance
- Implicit meaning
- Logical gaps
- Weak reasoning
Ability to write:
- Clear feedback
- Precise explanations
- Well-supported rationales
Consistent and objective judgment
Willingness to provide critical assessments when warranted
Strong attention to detail
Accurate application of structured evaluation criteria
Ability to complete work without AI writing tools
Eligibility
- Native English fluency required
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work
- Flexible schedule
- Weekly payments through Stripe or Wise
- Projects may be extended, shortened, or concluded based on business needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and enhance frontier AI systems using human expertise.
Contributors collaborate with researchers and domain experts on projects helping shape the next generation of AI technology.
You will be redirected to the company's website to complete your application.