Experienced Generalist

Role Overview

Mercor is seeking experienced generalist professionals to support a large-scale AI research project with a leading AI partner.

This project focuses on creating and refining diverse, human-aligned datasets used for supervised fine-tuning (SFT) of frontier AI models. As a Generalist, you will create realistic prompts, evaluate AI-generated responses, develop evaluation rubrics, and improve model outputs across a wide range of topics.

This is a short-term, project-based opportunity ideal for professionals with strong analytical thinking, writing, and critical reasoning skills.

Key Responsibilities

Create and Evaluate AI Training Tasks

• Develop high-quality prompts across a broad range of general knowledge topics.
• Evaluate AI-generated responses for:
  • Accuracy
  • Clarity
  • Completeness
  • Human alignment
  • Logical reasoning

Improve AI Responses

• Revise and refine AI-generated content.
• Create multiple prompt-response variations using different:
  • Writing styles
  • Response lengths
  • System prompts
  • Instructions

Benchmark AI Performance

• Identify failure points in model responses.
• Help improve benchmark datasets for frontier AI systems.

Develop Evaluation Rubrics

• Create structured rubrics for assessing prompt and response quality.
• Apply consistent evaluation standards across diverse task types.

Maintain Quality Standards

Work across content such as:

• Summaries
• Question & Answer tasks
• Content synthesis
• General reasoning tasks
• Instruction-following evaluations

Ideal Qualifications

• 2+ years of experience in one or more of the following:

  • Research
  • Education
  • Technical or professional writing
  • Editing
  • Other analytical fields

• Excellent written communication skills.

• Strong analytical thinking and critical reasoning.

• High attention to detail.

• Comfortable working independently with evolving project guidelines.

Preferred Qualifications

• Familiarity with:
  • Large Language Models (LLMs)
  • AI-assisted writing tools
  • Prompt engineering
  • AI evaluation workflows

Work Expectations

• Expected commitment of 10–25 hours per week.
• Flexible schedule.
• Batch-based project assignments.

Application Process

• Submit your resume.
• Complete the Domain Expert interview.
• Qualified applicants are typically contacted within a few business days.

Compensation

• $45–$60 per hour

Contract & Payment Terms

• Independent contractor engagement.
• Fully remote work.
• Flexible schedule.
• Weekly payments through Stripe or Wise.
• Projects may be extended, shortened, or concluded based on business needs and performance.

Important Note

Mercor currently cannot support:

• H1-B candidates.
• STEM OPT candidates.

About Mercor

Mercor partners with leading AI labs and enterprises to train and improve frontier AI systems using human expertise.

Contributors help shape the next generation of AI by creating high-quality datasets, evaluating model performance, and improving AI reasoning across a wide variety of real-world tasks.