Data Scientist - BYOD

Mercor is seeking experienced data scientists with legal ownership over data science-related work documents to contribute to frontier AI training and evaluation projects.

This role focuses on:

• Designing LLM prompts
• Evaluating AI model outputs
• Working on rubric-style assessment tasks
• Supporting advanced AI evaluation workflows

Candidates with prior Mercor experience on rubric-based projects are strongly preferred.

Key Responsibilities

• Design and refine prompts for large language model evaluation workflows

• Evaluate AI-generated outputs for:

  • Analytical quality
  • Technical correctness
  • Statistical reasoning
  • Alignment with evaluation rubrics

• Apply real-world data science expertise to improve AI training systems

• Work on rubric-based assessment tasks involving:

  • Data analysis
  • Modeling
  • Statistical reasoning
  • Machine learning concepts

• Contribute to the development of structured AI evaluation criteria

• Collaborate remotely with AI research and evaluation teams

• Maintain high standards of analytical rigor and technical accuracy

Required Skills & Qualifications

• Professional data science experience

• Legal ownership of data science-related work documents or materials

• Strong understanding of:

  • Data science workflows
  • Statistical analysis
  • Model evaluation
  • AI reasoning assessment

• Confidence designing:

  • LLM prompts
  • Evaluation rubrics
  • AI assessment workflows

• Ability to critically evaluate AI-generated outputs

• Strong written communication and analytical reasoning abilities

• Ability to work independently in remote environments

Preferred Qualifications

• Prior Mercor experience working on:

  • Rubric-style tasks
  • AI evaluation projects
  • LLM assessment workflows

• Background in:

  • Machine learning
  • Statistical modeling
  • AI benchmarking
  • Data science evaluation systems

Contract & Payment Information

• Independent contractor engagement

• Fully remote and asynchronous work environment

• Flexible scheduling

• Weekly payments via:

  • Stripe
  • Wise

• Projects may be:

  • Extended
  • Shortened
  • Ended early

depending on project needs and performance.

Please note:

• H1-B and STEM OPT candidates are not currently supported

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier AI models using human expertise.

Contributors work directly on projects focused on improving and evaluating next-generation AI systems.