Help secure frontier AI models by designing adversarial prompts, identifying jailbreaks and safety vulnerabilities, evaluating AI behavior across high-risk domains, and improving AI alignment through structured red-team assessments.
AI Safety Practitioner
Job description
Role Overview
Mercor is seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous scenarios. You will review AI-generated responses, apply AI safety policies, identify model failures, and provide structured feedback to improve model alignment and responsible AI behavior.
This is a flexible remote contract opportunity for professionals with experience in AI Safety, Trust & Safety, public policy, journalism, security, scientific research, or related disciplines who want to contribute to the development of safer AI systems.
Key Responsibilities
Evaluate AI Safety
- Review AI-generated responses for:
- Safety
- Factual accuracy
- Policy compliance
- Overall response quality
Assess High-Risk Content
- Evaluate responses involving:
- Misinformation
- Political persuasion
- Self-harm
- Violence
- Cybersecurity
- Biosecurity
- Other sensitive or policy-intensive domains
Improve AI Alignment
Apply and refine evaluation rubrics for:
- Reinforcement Learning from Human Feedback (RLHF)
- Supervised Fine-Tuning (SFT)
- AI safety benchmarking
Identify:
- Unsafe outputs
- Hallucinations
- Reasoning failures
- Policy violations
Provide structured written feedback to improve model safety and alignment.
Collaborate with AI Teams
- Work alongside AI researchers, engineers, and safety specialists.
- Contribute to ongoing evaluation and safety improvement initiatives.
Required Qualifications
Bachelor's degree or higher in one of the following (or a related discipline):
- Journalism
- Communications
- Psychology
- Sociology
- Public Policy
- Law
- Biology
- Chemistry
- Computer Science
5+ years of professional experience in:
- AI Safety
- Trust & Safety
- Journalism
- Public Policy
- Scientific Research
- Security
- Related fields
Excellent written English skills.
Strong analytical reasoning and critical thinking.
Ability to consistently evaluate nuanced, policy-sensitive content.
Preferred Qualifications
Experience with:
- AI Safety
- RLHF
- SFT
- Trust & Safety
- AI evaluation
Familiarity with:
- Safety policies
- Content moderation
- Evaluation rubric development
Experience reviewing complex, ambiguous, or high-risk content.
Compensation
- $60–$70 USD per hour
Work Arrangement
- Remote
- Independent contractor
- Flexible schedule
- Weekly payments via Stripe or Wise
You will be redirected to the company's website to complete your application.