Help develop clinician-informed benchmarks that evaluate how AI companion chatbots safely respond to adolescents experiencing mental health challenges.
Project Axiom — Axis Sanity Check Rater
Job description
About Project Axiom — Track 01: Axis Sanity Check
Mercor is recruiting clinicians and health-content researchers to evaluate and stress-test a four-axis taxonomy used for classifying health claims appearing across social media and podcast content.
This project focuses on assessing how effectively a structured taxonomy captures and categorizes modern health-related claims and narratives.
The taxonomy includes four classification axes:
- Domain
- Health Goal
- Action
- Frame
What You'll Do
The project takes approximately one hour and consists of a single self-paced online form.
Section A — Taxonomy Evaluation
Participants will:
- Evaluate the completeness of each taxonomy axis
- Rate each axis on a 1–5 scale
- Identify gaps, inconsistencies, or missing concepts
Section B — Claim Classification
Participants will:
- Tag 10 calibration health claims
- Apply all four taxonomy axes to each claim
- Assess classification consistency and clarity
Section C — Synthesis & Trustworthiness
Participants will answer:
- Two synthesis questions
- Feedback regarding taxonomy trustworthiness and usability
Ideal Background
This project is best suited for professionals with backgrounds in:
- Clinical medicine
- Public health
- Health communication
- Health journalism
- Health research
No prior taxonomy or ontology experience is required, as definitions and guidance are included in the form.
Work Environment & Compensation
- Fully remote contractor engagement
- Self-paced completion
- Single-session online review
- Approximate duration: 1 hour
- Compensation paid hourly for time spent completing the review
Payments are processed weekly through:
- Stripe
- Wise
Projects may be:
- Extended
- Shortened
- Concluded early
depending on business needs and contributor performance.
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier AI systems using expert human knowledge and domain-specific evaluation workflows.
Contributors help improve AI understanding of complex real-world reasoning, classification, and decision-making systems.
You will be redirected to the company's website to complete your application.