Evaluate AI-generated incident management, reliability engineering, and SRE deliverables including reports, spreadsheets, and presentations while providing expert operational and technical quality assessments.
DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Job description
About the Role
Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project.
This role focuses on evaluating and improving frontier AI coding models through realistic infrastructure engineering workflows and structured technical assessments.
Contributors use professional DevOps, Site Reliability Engineering (SRE), and Cloud Engineering expertise to review, compare, and improve AI-generated infrastructure implementations, automation workflows, reliability solutions, and cloud architectures.
Key Responsibilities
Evaluate AI Coding Agents
- Review AI-generated implementations involving cloud platforms, Kubernetes environments, CI/CD pipelines, infrastructure automation, and observability systems
Infrastructure Engineering Assessment
- Apply professional judgment to realistic infrastructure engineering scenarios
- Review cloud architectures, Infrastructure-as-Code implementations, deployment pipelines, monitoring systems, and reliability engineering strategies
Required Experience
- Minimum 2 years of professional experience in DevOps, Site Reliability Engineering (SRE), or Cloud Engineering
- Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD platforms, or observability tooling
Work Authorization
Must reside in a supported country. Supported regions include the United States, United Kingdom, Canada, Australia, and most of Europe (EU/EEA) plus select countries in Latin America and the Balkans.
Important Note
Mercor currently cannot support H1-B or STEM OPT candidates.
Compensation
- $400 per accepted task (~$85/hr effective rate)
About Mercor
Mercor partners with leading AI labs and enterprises to train and evaluate frontier AI systems using expert human knowledge.
You will be redirected to the company's website to complete your application.