Evaluate AI-generated intellectual property, trademark, and copyright law analyses, legal documentation, and compliance materials for accuracy, rigor, and legal quality.
Legal Quality Assurance Lead (QAL)
United States
Up to $120/hr
June 15, 2026
Job description
About the Role
This is a remote, hourly contractor role for a Legal Quality Assurance Lead (QAL) responsible for overseeing quality, consistency, and contributor performance across legal AI training projects.
You will review AI-generated legal content, evaluate trainer and QA work, provide detailed feedback, maintain quality standards, support onboarding efforts, and ensure compliance with legal review guidelines and project rubrics.
The role combines legal expertise, quality assurance, AI evaluation, contributor management, documentation, risk assessment, and process improvement.
Key Responsibilities
Quality Monitoring
- Review legal training items and QA outputs
- Identify recurring quality issues and legal-review errors
- Provide actionable feedback to contributors
- Escalate critical quality concerns
Legal Review
Evaluate AI-generated legal explanations, legal research responses, contract analyses, policy interpretations, case summaries, compliance guidance, regulatory analyses, legal issue-spotting exercises, legal writing samples, jurisdiction-specific responses, and legal reasoning workflows.
Verify legal accuracy, reasoning quality, jurisdictional appropriateness, citation quality, source reliability, risk awareness, instruction compliance, clarity of explanation, and appropriate legal caution.
Trainer & QA Communication
- Communicate guideline updates and workflow changes
- Clarify legal-review standards
- Maintain contributor alignment
Question Resolution
Respond to contributor questions regarding legal reasoning, jurisdictional considerations, citation standards, source reliability, contract language, compliance interpretation, risk disclosures, legal disclaimers, formatting expectations, and rubric interpretation.
Contributor Activation Management
- Follow up with inactive contributors and track engagement
- Encourage participation and task completion
Documentation Management
Create and maintain style guides, legal FAQs, quality notes, calibration tasks, examples, trackers, honeypots, and onboarding materials.
Onboarding & Training
- Conduct onboarding and training sessions
- Explain project workflows, evaluation rubrics, legal review standards, risk-awareness requirements, jurisdictional review practices, citation expectations, and legal writing quality standards
Risk & Safety Review
Identify and flag unsafe legal guidance, overconfident legal conclusions, unsupported legal claims, personalized legal advice risks, jurisdictional mismatches, hallucinated legal citations, incorrect legal standards, missing disclaimers, and misleading compliance guidance.
Process Improvement
- Identify recurring quality gaps and recommend workflow improvements
- Help build scalable QA processes for legal AI projects
Required Skills & Qualifications
- Bachelor's degree, JD, LLB, LLM, or equivalent degree in Law, Legal Studies, Paralegal Studies, Compliance, Public Policy, or related discipline
- 3+ years of professional experience in legal practice, legal research, contract review, compliance, regulatory analysis, paralegal work, legal operations, legal writing, or legal education
- Strong understanding of legal reasoning, issue spotting, contract interpretation, legal research, statutory interpretation, case analysis, compliance, regulatory review, risk assessment, legal writing standards, and jurisdictional considerations
- Ability to identify unsupported conclusions, hallucinated citations, jurisdictional mismatches, overconfident legal advice, missing caveats, incorrect legal standards, incomplete reasoning, and weak legal analysis
- Strong written English, legal-review feedback, and documentation skills
Preferred Qualifications
- Experience with contract review workflows, legal memoranda, case summaries, legal databases, citation checking, regulatory guidance review, or document review systems
- Experience leading or supporting lawyers, paralegals, legal researchers, legal writers, review teams, or QA teams
- Experience with AI training, data annotation, LLM evaluation, or rubric-based QA
- Familiarity with Discord, Google Docs, Google Sheets, and project management systems
Additional Information
- Fully remote — Flexible schedule — Weekly payments
- Access to future opportunities through the SME Careers expert network
About SME Careers
SME Careers is an AI data services company and subsidiary of SuperAnnotate that provides training data for leading AI companies and foundation-model laboratories.
Apply now
You will be redirected to the company's website to complete your application.
Evaluate AI-generated legal contracts, diligence reviews, and redline analyses including reports, spreadsheets, and presentations while providing expert legal and risk-focused quality assessments.
Evaluate AI-generated legal and compliance deliverables and provide expert regulatory, governance, and legal quality assessments. Apply real-world legal and compliance expertise to determine whether outputs meet professional standards.
Remote legal research SME opportunity reviewing AI-generated legal analysis, citations, and research outputs while helping train and evaluate advanced AI systems for leading AI companies.