Help train frontier AI systems by creating legal reasoning tasks and evaluating AI-generated legal analyses. Create realistic legal scenarios and develop high-quality reference answers and grading rubrics.
Legal Expert
Job description
Role Overview
Mercor is hiring Legal Experts to support a leading AI research lab focused on training frontier models with advanced legal reasoning capabilities. In this remote contract role, you will evaluate AI-generated legal responses, compare model outputs, and provide expert feedback to improve how AI systems understand and apply legal principles.
Your legal expertise will help ensure AI reasoning is accurate, well-supported, and aligned with real-world legal practice.
Key Responsibilities
Evaluate AI Legal Reasoning
- Compare two AI-generated responses to the same legal prompt.
- Analyze model reasoning and determine which response is stronger.
- Assess:
- Legal accuracy
- Quality of reasoning
- Application of legal principles
- Practical usefulness
- Client-readiness
Provide Expert Feedback
- Explain why one AI output is superior to another.
- Identify legal errors, weak arguments, missing authorities, or flawed analysis.
- Provide written feedback used to improve AI model performance.
Legal Research & Analysis
- Review challenging legal scenarios involving:
- Case law
- Contracts
- Regulations
- Legal principles
- Apply professional legal judgment when evaluating responses.
Calibration & Quality Improvement
- Participate in onboarding and specialty calibration sessions.
- Maintain consistent evaluation standards across legal tasks.
Ideal Qualifications
- Hold one of the following:
- J.D.
- LL.B.
- LL.M.
- Equivalent legal qualification or professional legal experience
- 2+ years of professional experience in:
- Legal practice
- Legal research
- Law firms
- Government
- Judiciary
- In-house legal roles
- Strong legal research and writing skills.
- Experience analyzing case law and legal arguments.
- Excellent written communication and attention to detail.
Compensation
- $90 per hour
Job Details
- Remote
- Independent Contractor
- Flexible workload: 10–20 hours/week
- Immediate start
- Rolling applications
Application Process
- Submit application details.
- Complete required evaluation or onboarding steps.
- Begin contributing to AI legal reasoning projects after approval.
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier AI systems using expert human knowledge. Contributors help improve the next generation of AI models through specialized evaluation and high-quality training data.
You will be redirected to the company's website to complete your application.