Pay: 100–170/hour Role Type: Contractor Location: Remote, US-based only We are seeking experienced U.S.-licensed lawyers across a broad range of legal practice areas to contribute to a project focused on improving the legal reasoning, accuracy, and judgment of advanced…
Legal Reasoning AI Response Evaluator
Remote (Global)
$55 – $100/hr
June 29, 2026
Job description
You'll evaluate AI-generated responses to legal questions — covering case analysis, statutory interpretation, procedural questions, and litigation strategy. Your primary task is assessing whether a model's answer reflects sound legal reasoning, accurate doctrinal knowledge, and appropriate caveats. This isn't about copy-editing; you're judging whether the legal analysis would hold up in front of a practitioner, and flagging anything that could mislead a non-expert relying on the output.
Day-to-day work involves reading a legal prompt, reviewing the model's response, and scoring it across dimensions like analytical rigor, jurisdictional accuracy, and practical usefulness. For litigation-focused tasks, you'll also evaluate whether the model correctly identifies procedural posture, burden of proof, and viable arguments. Feedback is written in structured rubric fields, with an optional free-text section for nuanced critique. Tasks are asynchronous — you work batches on your own schedule through a browser-based annotation platform.
A minimum of 3 years of litigation or substantive legal practice is required. Familiarity with U.S. federal and state court procedure is expected; experience in additional jurisdictions is a bonus. Law professors and clerks are also strong candidates. You do not need to be currently practicing, but you must be able to credibly evaluate whether legal reasoning is sound, not just grammatically correct.
Skills
- Legal reasoning and case analysis
- Litigation and civil procedure
- Statutory and regulatory interpretation
- Analytical writing
- Jurisdictional knowledge (US federal/state)
FAQ
Do I need to be a currently licensed attorney?
No. Bar admission is not required. What matters is demonstrated expertise in legal reasoning — practitioners who are inactive, retired, law professors, or experienced paralegals with substantial substantive exposure may qualify. You'll complete a paid qualification task during onboarding to confirm your evaluation accuracy.
Is the work focused on a specific area of law?
Task batches are organized by practice area (e.g., contracts, torts, criminal procedure, admin law). You can indicate your specializations during onboarding and will be preferentially routed tasks that match. You're not required to take tasks outside your expertise.
How long does a typical task take?
Most tasks involve a single legal prompt and a model response of 200–600 words. Evaluation typically takes 8–20 minutes depending on complexity. Longer analytical tasks (e.g., multi-issue memo evaluation) are compensated at a higher per-task rate and flagged clearly before you accept them.
Apply now
Opens app.claru.ai in a new tab. If they ask how you found the role, mention RemoWork.
Pay: 70–90/hour Role Type: Contractor Location: Remote We are seeking a detail-oriented Junior Transactional Attorney for a part-time opportunity at the intersection of legal practice and artificial intelligence.
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly…
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly…