Help develop clinician-informed benchmarks that evaluate how AI companion chatbots safely respond to adolescents experiencing mental health challenges.
Radiologist
Originally posted May 27, 2026.
Job description
As a Radiologist Subject Matter Expert (SME), you will work remotely reviewing AI-generated radiology and medical imaging content while helping improve advanced AI systems used for imaging interpretation, clinical reasoning, and patient-facing medical explanations.
This role focuses on evaluating imaging decision-making, identifying diagnostic reasoning issues, and producing high-quality radiology explanations and reference solutions grounded in evidence-based imaging practices.
Contributors help train AI systems through real-world expertise in:
- Diagnostic radiology
- Imaging appropriateness
- Differential diagnosis
- Protocol selection
- Patient safety
- Clinical imaging workflows
Key Responsibilities
Review AI-generated:
- Radiology content
- Imaging interpretations
- Clinical reasoning workflows
- Diagnostic explanations
Assess responses for:
- Accuracy
- Clinical safety
- Clarity
- Scientific rigor
- Prompt adherence
Identify issues involving:
- Imaging appropriateness
- Differential diagnosis reasoning
- Modality selection
- Protocol choices
- Incidental findings
- Patient safety considerations
Evaluate imaging recommendations involving:
- CT
- MRI
- Ultrasound
- X-ray
- Contrast usage
- Radiation exposure
Review safety considerations involving:
- Contrast reactions
- Renal function
- Pregnancy
- Radiation dose
- Allergies
- Anticoagulation risks
Assess internal consistency across:
- Clinical presentation
- Imaging modality
- Findings
- Impression
- Recommended next steps
Write:
- Clinical explanations
- Step-by-step diagnostic reasoning
- Gold-standard radiology answers
- Reference solutions
Compare and evaluate AI responses based on:
- Diagnostic accuracy
- Clinical safety
- Evidence quality
- Reasoning quality
Contribute to AI model evaluation and radiology training workflows
Required Qualifications
MD/DO or equivalent medical degree
Completed Diagnostic Radiology residency
Board eligible/certified in Radiology or equivalent local certification
Minimum 5 years of professional radiology practice experience
Strong expertise involving:
- Imaging strategy
- Differential diagnosis
- Clinical reasoning
- Imaging appropriateness
Deep understanding of:
- Imaging modalities
- Sensitivity/specificity tradeoffs
- Artifacts
- Protocol optimization
- Imaging limitations
Strong patient-safety knowledge involving:
- Contrast safety
- Radiation safety
- Pregnancy considerations
- Nephrotoxicity risks
- Procedure risks
Ability to identify:
- Unsafe assumptions
- Missed critical diagnoses
- Inconsistent reasoning
- Misleading explanations
C1-level English proficiency
Strong medical writing and fact-checking abilities
Ability to work independently in remote asynchronous workflows
Preferred Qualifications
Experience involving:
- AI training workflows
- Report QA
- Peer review
- Utilization management
- Medical editorial work
- AI-generated content evaluation
Strong evidence-based imaging expertise
Exceptional diagnostic attention to detail
Work Structure
- Fully remote contractor role
- Flexible work schedule
- Hourly compensation
- Weekly payments after approved work
Important Note
There is currently no immediate active project for this role. Qualified candidates will join the expert network and may be contacted for future opportunities and AI-related projects.
About SME Careers
SME Careers is an AI data services company and subsidiary of SuperAnnotate that provides expert training data to leading AI companies and foundation model labs worldwide.
Contributors directly help improve how advanced AI systems reason about medical imaging, radiology interpretation, and clinical diagnostic workflows.
You will be redirected to the company's website to complete your application.