Curated remote opportunities

Remote Evaluation & Quality Jobs in North America 2026

253 remote jobs open to candidates in North America in Evaluation & Quality. Updated daily.

iMerit
English AI Training +12 Precision Accuracy Nuance Editing Writing Translation Journalism Annotation Make Machine Learning Flexible AI Training
  • United States
  • $35/hr
  • Sep 24, 2026

iMerit - an EXL Company, is hiring English Language Specialists to bring precise, native-quality language judgment to multimodal AI systems (text, image, video, and audio combined) used by some of the world's leading AI labs.

Thyme Care
Assurance Make AI +12 Organization Automation Collaboration Microsoft Teams Quality Assurance Calibration Rubrics Leadership Training Philosophy Accuracy Consistency
  • United States
  • $31.25 / hour
  • Sep 23, 2026

We exist to create a more connected, compassionate, and confident experience for people with cancer and those who care for them. We make it easier to get answers, access high-quality care quickly, and feel supported throughout treatment and beyond.

Sovrano AI
Red Team / Safety Evaluator Part-time ↘ +6 regions
AI Training Biosafety +12 Biosecurity Physics Engineering Accuracy Writing English Monday.com Chemistry Microbiology Biology Management Communication
  • United States, United Kingdom, Canada +3AustraliaNew ZealandEurope
  • $35 – $49/hr
  • Sep 21, 2026

Sovrano AI builds evaluation and training data for frontier AI labs, and this project is about where those models handle hazardous material badly.

Mercor
CRM Accounting Microsoft Teams +10 Assurance Compliance Accuracy Data Protection Annotation Quality Assurance Editorial Review Compliance Review Written Feedback Data Annotation
  • United States
  • $45 – $60/hr
  • Sep 19, 2026

We're hiring Reviewers on a contract basis for Project Sisyphus, a PII anonymization program. Writers work through business documents and structured records (CRM exports, email, tickets, chat logs, accounting data) confirming what is and isn't personal information and grouping…

Innodata
Response Rater Full-time
AI Engineering Communication +12 Critical Thinking Consistency Recruiting Economics Reporting Voice Evaluation Data Engineering Artificial Intelligence Data Evaluation Evaluation Frameworks Generative AI Attention to Detail
  • United States (US: AK, AL, AR +11)
  • $20 – $25/hr
  • Sep 19, 2026

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked.

Weekday
AI English Finnish +12 Testing Cybersecurity Machine Learning RLHF DPO Engineering Analysis Psychology Acting Writing AI Safety Language Skills
  • United States
  • $48 – $62/hr
  • Sep 16, 2026

Fluent Language Skills Required: English & Finnish. Native fluency in English and Finnish is required for this position. Why This Role Exists We are assembling a red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities,…

SME Careers
Red Team / Safety Evaluator Full-time ↘ +5 regions
AI Audit Writing +12 Training Accuracy Chemistry Engineering Management Compliance Data Classification Documentation Communication Procedures Alignment Experimentation
  • Australia, Canada, New Zealand +2United KingdomUnited States
  • $1 – $100/hr
  • Sep 15, 2026

## Description SME Careers is hiring explosives and energetic materials professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it.

SME Careers
Red Team / Safety Evaluator Contractor ↘ +5 regions
AI Audit Chemical Security +12 Training Accuracy Chemistry Engineering Management Compliance Documentation Communication Procedures Alignment Experimentation English
  • Australia, Canada, New Zealand +2United KingdomUnited States
  • Up to $100/hr
  • Sep 15, 2026

## Description SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it.

Meridial AI
Response Rater Contractor
English Accuracy Research +5 Make Verification Search Evaluation Reading Comprehension Analytical Skills
  • United States
  • $20/hr
  • Sep 15, 2026

We are seeking English-fluent experts located in the United States to contribute to a search evaluation project as independent contractors. Experts will review and compare sets of search results, assessing factors such as relevance, accuracy, usefulness, and overall quality.

Mercor
Research Microsoft Teams AI +12 Training MATCH Writing Communication Reasoning Athletics Culture Gaming Esports Geography Electronics AI Training
  • Remote (Global)
  • $50 – $75/hr
  • Sep 15, 2026

The research teams behind the best-known AI models come to Mercor for consumer and lifestyle judgment they can't generate on their own. Your standards and expertise become the rubric that frontier AI is graded against.

Mercor
Chemistry AI Reasoning +10 Writing Red Teaming Monitoring Analysis Make Research Chemical Safety Trend monitoring Report writing Technical Writing
  • Remote (Global)
  • Sep 14, 2026

Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing genuinely dangerous…

Mercor
Chemistry AI Reasoning +12 Analysis Writing Red Teaming Strategic Thinking Management Compliance Make Research Process Safety Chemical Safety Regulatory Compliance Technical Writing
  • Remote (Global)
  • Sep 14, 2026

Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing genuinely dangerous…

Mercor
Chemistry AI Reasoning +9 Writing Red Teaming Analysis Quality Assurance Testing Make Research Chemical Safety Technical Writing
  • Remote (Global)
  • Sep 14, 2026

Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing genuinely dangerous…

Mercor
Chemistry AI Reasoning +12 Medicine Writing Red Teaming Engineering Sourcing Troubleshooting Make Research Chemical Safety Reaction Engineering Safety Review Technical Writing
  • Remote (Global)
  • Sep 14, 2026

Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing genuinely dangerous…

Mercor
Chemistry AI Reasoning +10 Verification Writing Red Teaming Research Analysis Management Make Chemical Safety Laboratory Analysis Technical Writing
  • Remote (Global)
  • Sep 14, 2026

Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing genuinely dangerous…

Mercor
AI Reasoning Writing +11 Red Teaming Monitoring Management Reconciliation Compliance Training Auditing Make Research Regulatory Compliance Technical Writing
  • Remote (Global)
  • Sep 14, 2026

Mercor is assembling a panel of energetic materials and propulsion experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing genuinely…

Mercor
AI Reasoning Analysis +10 Logic Engineering Writing Red Teaming Command Line Instrumentation Make Research System Design Technical Writing
  • Remote (Global)
  • Sep 14, 2026

Mercor is assembling a panel of energetic materials and propulsion experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing genuinely…

Stay in the loop.

One email per week, 5 hand-picked roles.