Mercor is hiring practicing orthodontists (DDS and DMD) to help build rigorous evaluations of how well AI reads real dental imaging, in partnership with a leading AI lab. This is not image labeling.
Clinical AI Evaluator – Licensed US Physician (MD/DO)
United States
From $45/hr
October 23, 2026
Job description
Job Description: Clinical AI Evaluator – Licensed US Physician (MD/DO)
Company: Truelancer AI
Location: United States
Engagement Type: Independent Contractor
Workload: 10–20 hours per week
Minimum Experience: 3+ years
Project Overview
Truelancer AI is seeking licensed, actively practicing US physicians (MD/DO) to participate in a medical AI evaluation project. Selected candidates will review clinical case scenarios and evaluate AI-generated medical responses for clinical accuracy, diagnostic reasoning, and treatment appropriateness.
This opportunity is ideal for physicians with strong clinical judgment, recent patient-care experience, and the ability to assess medical information against established clinical standards.
Key Responsibilities
- Review clinical case scenarios covering a range of medical conditions.
- Evaluate AI-generated diagnoses, treatment recommendations, and alternative answers for clinical accuracy.
- Assess the quality and validity of clinical reasoning based on the information provided.
- Review clinical questions and answers for clarity, completeness, and appropriate structure.
- Evaluate alternative answer choices and identify potential clinical reasoning errors.
- Provide concise, evidence-based explanations to support evaluation decisions.
- Participate in independent assessments and physician reviews to resolve differences in clinical judgment.
- Maintain high standards of accuracy, consistency, and quality throughout the project.
Required Qualifications
- MD or DO degree from an accredited medical school.
- Currently residing in the United States.
- Active, unrestricted US medical licence, subject to verification.
- Completed residency training.
- Minimum 3 years of relevant clinical experience.
- Currently practising medicine, with recent direct patient-care experience.
- Strong clinical knowledge across multiple medical specialties, particularly diagnosis and treatment.
- Excellent written English communication skills.
- Strong analytical skills and attention to detail.
Preferred: Board-certified physicians and candidates with attending-level clinical experience.
Preferred Specialties
Physicians practising in the following specialties are particularly encouraged to apply:
- Internal Medicine / General Medicine
- Family Medicine
- Hospital Medicine / Hospitalists
- Emergency Medicine
Experience in medical AI evaluation, clinical content review, medical question development, examination question validation, or clinical annotation and quality assurance will be an added advantage.
Project Commitment
- Duration: Approximately 4 weeks.
- Workload: 10–20 hours per week.
- Start Date: Expected in early November 2026.
- Engagement: Independent contractor under a task-based Statement of Work (SOW).
Candidates should be available to commit to the project schedule and complete assigned evaluations within the agreed timelines.
Important Eligibility Criteria
Applicants must meet all the following requirements:
- Hold an MD or DO degree.
- Have completed residency training.
- Hold an active, unrestricted US medical licence.
- Be currently based in the United States and actively practising medicine.
- Confirm their current state of residence during screening.
Candidates residing in the following states are not eligible for this project:
Alaska, Arkansas, California, Connecticut, Delaware, Georgia, Hawaii, Illinois, Indiana, Kansas, Louisiana, Maine, Maryland, Massachusetts, Nebraska, Nevada, New Hampshire, New Jersey, New Mexico, Ohio, Oregon, Tennessee, Utah, Vermont, Washington, and West Virginia.
The following applicants are not eligible: Medical students, unlicensed medical graduates, nurses, nurse practitioners, physician assistants, pharmacists, and other non-physician healthcare professionals.
How to Apply
If you meet the eligibility criteria and are interested in contributing your clinical expertise to medical AI evaluation, please share your updated CV and confirm:
- Your medical degree (MD/DO).
- Your primary specialty.
- Your years of clinical experience.
- Your current US state of residence.
- Your active US medical licence status.
- Your current clinical practice status and availability for 10–20 hours per week.
Shortlisted candidates will be contacted for further screening and licence verification.
Join Truelancer AI and help improve the accuracy and clinical reliability of AI-generated medical responses.
Screening & Qualification Details
- Which state you are located in?
Apply now
Opens ai.truelancer.com in a new tab. If they ask how you found the role, mention RemoWork.
Mercor is hiring fellowship-trained breast imaging radiologists (MDs and DOs) to help build rigorous evaluations of how well AI reads real imaging studies, in partnership with a leading AI lab. This is not image labeling.
Compensation: $60-$70 USD per hour micro1 is engaging Registered Nurses to contribute their expertise to a dynamic project for a valued customer. In this role, you'll apply your inpatient clinical expertise to help train next-generation AI systems.
AI labs need medical content checked by people who have treated patients. A model can sound confident about a diagnosis or a dosing decision and be wrong in a way only a clinician catches. That gap is the work. This listing is a waitlist, not an open position.