Back to remote jobs

Incident Management / Reliability / SRE Evaluator

Mercor

AI Expert - Cloud & DevOps Contractor
Remote (Global) $80 – $120/hr June 6, 2026

Job description

About the Role

Mercor is seeking expert evaluators with deep experience in incident management, reliability engineering, and Site Reliability Engineering (SRE) to assess AI-generated work products for accuracy, rigor, and domain quality.

This is a remote, hourly contract opportunity focused on reviewing documents, spreadsheets, and presentation decks produced by AI systems.

Evaluators will apply real-world operational and reliability expertise to determine whether outputs meet professional standards, demonstrate sound engineering judgment, and accurately reflect incident response, system reliability, service operations, and production engineering best practices.

What You'll Do

  • Evaluate AI-generated artifacts including:

- Documents

- Spreadsheets

- Slide decks

  • Assess outputs using domain-specific quality rubrics
  • Review work for:

- Technical accuracy

- Operational rigor

- Reliability best practices

- Domain quality

- Professional presentation

  • Identify:

- Technical errors

- Reliability risks

- Incident management flaws

- Presentation weaknesses

- Aesthetic issues

- Logical inconsistencies

  • Provide clear and structured written feedback
  • Apply professional judgment when evaluating SRE, production operations, and incident response content

Required Qualifications

  • 5+ years of professional experience in:

- Site Reliability Engineering (SRE)

- Incident Management

- Reliability Engineering

- Production Operations

- Platform Engineering

- Infrastructure Engineering

- Related technical disciplines

  • Native or professional fluency in English
  • Strong analytical and evaluation skills
  • Ability to assess technical and operational materials objectively and consistently

Technical Requirements

  • Highly proficient with:

- Microsoft Office

- Google Workspace

Presentation Tools

  • Google Slides
  • Microsoft PowerPoint

Analysis Tools

  • Microsoft Excel
  • Google Sheets

Preferred Qualifications

  • Master's degree or higher
  • Advanced degree in:

- Computer Science

- Software Engineering

- Information Systems

- Related technical disciplines

  • Experience reviewing:

- Incident reports

- Postmortems

- Reliability analyses

- Service-level reports

- Operational runbooks

- Engineering presentations

  • Experience with:

- SLOs and SLIs

- Observability platforms

- Incident command processes

- Capacity planning

- Production systems at scale

Contract & Payment Terms

  • Independent contractor engagement
  • Fully remote work
  • Flexible schedule
  • Weekly payments through Stripe or Wise
  • Projects may be extended, shortened, or concluded based on business needs and performance

Important Note

Mercor currently cannot support:

  • H1-B candidates
  • STEM OPT candidates

About Mercor

Mercor partners with leading AI labs and enterprises to train and evaluate frontier AI systems using human expertise.

Contributors help improve the quality, reliability, and technical accuracy of AI-generated work products used across reliability engineering, incident management, and production operations environments.

Apply now

You will be redirected to the company's website to complete your application.

Categories

Explore other opportunities in related specializations.

AI & Data Training Engineering & Development Data & Analytics Design & Creative Product & Project Management Marketing & Growth Sales & Business Development Customer Support & Success HR & People Operations Finance & Accounting Legal & Compliance Operations & Administration Healthcare & Clinical Science & Research Education & Training Writing & Content Translation & Localization Media & Entertainment Consulting & Strategy Nonprofit, Social Impact & Other Travel & Hospitality Sports & Fitness Fashion, Beauty & Lifestyle

Frequently asked questions

Is Mercor legitimate?
Yes, Mercor is a legitimate company listed on RemoWork. We verify all companies on our platform. However, we always recommend doing your own research before sharing personal information or starting work. Check reviews from other users and visit the company's official website for the most up-to-date information.
How do I get started with Mercor?
To get started, visit Mercor's official website and look for their careers or sign-up page. Create an account, complete your profile with relevant skills and experience, and apply for available positions or projects. Some companies may require you to pass a qualification test or assessment before you can start working.
Does Mercor offer remote work?
Yes, Mercor offers remote work opportunities. Most tasks and positions can be completed from anywhere with a reliable internet connection and a computer or smartphone. Specific location requirements may vary by project or role, so check individual listings for details.
How does Mercor pay its workers?
Payment methods and schedules vary. Common payment options include PayPal, bank transfers, Payoneer, and other digital payment platforms. Visit Mercor's official website or check their payment/FAQ section for specific details about payment methods, minimum thresholds, and payout schedules.
What skills do I need to work with Mercor?
Required skills vary by role and project. Generally, you'll need a reliable internet connection, basic computer literacy, strong attention to detail, and good communication skills. Some positions may require specialized expertise, language proficiency, or technical qualifications. Check individual job listings for specific requirements.
What is Mercor's vetting process like?
Mercor uses an AI-powered vetting process that evaluates candidates through technical assessments, interviews, and skill verification. The platform matches vetted talent with companies looking for specific expertise. The process is designed to be efficient and identify top-tier professionals quickly.
What types of roles does Mercor offer?
Mercor connects professionals with AI engineering, software development, data science, machine learning, and other tech-focused roles. The platform works with startups and enterprises, offering both contract and full-time remote positions across various technical domains.
Is Mercor free for job seekers?
Yes, Mercor is free for job seekers and freelancers. The platform earns revenue from companies hiring through the network. Candidates can create profiles, get vetted, and apply for positions at no cost.
Apply now

Stay in the loop.

One email per week, 5 hand-picked roles.