Medical General Expert

SME Careers is seeking Medical General Experts to help evaluate and improve advanced AI systems on clinical reasoning, patient care, public health, and healthcare decision-making tasks.

This fully remote contract opportunity focuses on:

• Clinical reasoning evaluation
• AI-generated healthcare content review
• Medical fact-checking
• Patient safety assessment
• Evidence-based medicine analysis
• AI training content development

Contributors will help improve how frontier AI systems understand, reason about, and communicate medical and healthcare concepts across clinical and public health domains.

This is part of SME Careers’ expert network program for future AI training and evaluation projects.

Key Responsibilities

• Review and evaluate AI-generated medical responses for:

  • Clinical accuracy
  • Logical reasoning
  • Prompt adherence
  • Patient safety
  • Clarity and completeness

• Create and refine:

  • Healthcare-focused AI prompts
  • Clinical explanations
  • Medical reasoning examples
  • Model healthcare solutions

• Identify:

  • Unsafe assumptions
  • Missing contraindications
  • Incorrect diagnoses
  • Misinterpretation of tests
  • Flawed clinical reasoning
  • Public health inaccuracies

• Evaluate and compare AI-generated responses based on:

  • Correctness
  • Evidence-based reasoning
  • Clinical appropriateness
  • Risk assessment
  • Safety considerations

• Assess AI performance across topics such as:

  • Clinical medicine
  • Differential diagnosis
  • Patient care
  • Public health
  • Epidemiology
  • Healthcare systems
  • Risk stratification
  • Disease processes
  • Medical terminology
  • Healthcare workflows

• Review medical outputs for:

  • Internal consistency
  • Physiological plausibility
  • Timeline accuracy
  • Dosing logic
  • Care setting appropriateness

• Test AI systems for:

  • Reliability
  • Hallucinations
  • Unsafe medical reasoning
  • Biases
  • Clinical inconsistencies

Required Qualifications

• Bachelor’s degree or higher in:

  • Medicine (MD/DO)
  • Nursing
  • Public Health
  • Health Sciences
  • Allied Health
  • Related healthcare disciplines

• Minimum 5 years of professional experience in:

  • Clinical healthcare
  • Nursing
  • Public health
  • Allied health
  • Healthcare systems

• Strong understanding of:

  • Clinical reasoning
  • Differential diagnosis
  • Epidemiology
  • Disease processes
  • Risk stratification
  • Evidence-based medicine
  • Healthcare systems

• Strong ability to:

  • Fact-check medical content
  • Assess patient safety implications
  • Evaluate medical reasoning
  • Identify unsafe recommendations

• Excellent English writing and communication skills

• Minimum C1 English proficiency

• Ability to work independently in remote contractor environments

Preferred Qualifications

• Experience with:

  • AI training
  • AI annotation
  • AI evaluation
  • Clinical documentation review
  • Utilization review
  • Healthcare editorial QA

• Experience evaluating:

  • Medical workflows
  • Clinical documentation
  • Healthcare quality standards

Additional Information

• No immediate active project
• Qualified experts will join SME Careers’ expert network for future opportunities
• Flexible remote work schedule
• Weekly payments after approved work
• Referral bonus opportunities available

About SME Careers

SME Careers is an AI Data Services company and subsidiary of SuperAnnotate focused on improving frontier AI systems through expert healthcare evaluation and AI training workflows.

The company partners with major AI labs and foundation model developers to improve medical reasoning, patient safety awareness, and healthcare communication quality in advanced AI systems.