AfterQuery is looking for open source maintainers to review code for a paid, remote project. You will review real engineering tasks and judge the quality of the work, the same way you review pull requests on the projects you maintain.
Curated remote opportunities
Remote LLM Evaluator (Code) Jobs in United States 2026
35 remote jobs open to candidates in United States in LLM Evaluator (Code). Updated daily.
AI
Codex
Claude
+12
Engineering
Writing
Reasoning
Communication
Syntax
Cursor
Go
Python
Rust
TypeScript
JavaScript
IDEs
We’re looking for highly experienced software engineer to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role. You won’t be writing production code.
Research
AI
Training
+12
Reasoning
STEM
Programming
Accuracy
English
Russian
Spanish
French
Mandarin Chinese
Portuguese
Persian
Arabic
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.
AI
Engineering
Leadership
+12
Microsoft Teams
Programming
Reasoning
Architecture
Debugging
English
Algorithms
Finance
Research
Software Engineering
System Design
Code Quality
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly…
AI
Training
Codex
+12
Claude
Engineering
Writing
Reasoning
Communication
Syntax
Cursor
TypeScript
JavaScript
Python
English
Mentoring
Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week Please note that eligibility may vary depending on your location, as some regions may not be supported by the client.
Research
AI
Java
+12
Rust
C++
Go
TypeScript
Adaptability
Accuracy
Training
Open Source
Programming
Analysis
Algorithms
Communication
Role Title: Research Engineer - Code Generation & Model Evaluation Role Type: Contractor Location: Remote micro1 is engaging Research Engineers to participate in a project focused on code generation and model evaluation for a customer's initiative.
AI
Training
C++
+12
C#
Python
Java
JavaScript
Writing
Verification
Education
Engineering
English
Flexible
AI Training
Artificial Intelligence
(C++, C#, Python, Java, Javascript) We are seeking experienced software engineers and coders to be part of the artificial intelligence (AI) revolution.
AI
Training
Codex
+12
Claude
Engineering
Writing
Reasoning
Communication
Syntax
Cursor
TypeScript
JavaScript
Python
English
Mentoring
Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week Please note that eligibility may vary depending on your location, as some regions may not be supported by the client.
JavaScript
AI
Training
+12
Reasoning
Problem Solving
Accuracy
ES6
Logic
Engineering
Mentoring
LLMs
Programming
English
Writing
React
As an hourly paid, fully remote JavaScript Engineer for AI Data Training, you will review complex AI-generated code and explanations or generate new ones, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps models produce…
Python
Logic
Algorithms
+12
Programming
Pandas
NumPy
Scripting
Machine Learning
Analysis
Annotation
Infrastructure
JavaScript
SQL
Language Models
Structured Feedback
Your primary work is reviewing Python code produced by language models in response to natural-language coding prompts. For each task you'll receive the original prompt, one or more model-generated code snippets, and a rubric covering correctness, efficiency, readability, and…
JavaScript
TypeScript
Java
+12
Node.js
APIs
SQL
Web Security
Architecture
Engineering
Onboarding
MATCH
Code Review
Backend Development
Written Feedback
Quality Review
You'll review AI-generated code across the full web stack — JavaScript, TypeScript, Java backend services, and Node.js APIs — assessing correctness, security, maintainability, and adherence to the task specification.
Verification
mathlib
AI
+12
Reasoning
Express.js
Flexible
Research
Organization
Mathematics
Logic
Writing
Algebra
Analysis
Topology
Coq
What if your deepest mathematical expertise could directly shape how AI understands and reasons about formal proof? We're looking for Formal Verification Scientists to translate advanced mathematical arguments into machine-verifiable Lean 4 proofs — pushing the boundary of what…
Training
AI
Research
+12
Reasoning
Verification
Flexible
Organization
Mathematics
Logic
Writing
Algebra
Analysis
Topology
Coq
Isabelle
What if your deep mathematical training could directly shape how AI reasons about proofs — pushing the boundaries of what machines can verify, understand, and automate?
JSON
French
Sourcing
+12
Accuracy
Alignment
Pronunciation
Formatting
Logic
Syntax
English
LLMs
Automation
Scripting
Customer Support
Canadian French
We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs for accuracy, clarity, and alignment with project guidelines.
JSON
Italian
Sourcing
+11
Accuracy
Alignment
Pronunciation
Formatting
Logic
Syntax
English
LLMs
Automation
Scripting
Customer Support
We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs for accuracy, clarity, and alignment with project guidelines.
JSON
Dutch
Sourcing
+11
Accuracy
Alignment
Pronunciation
Formatting
Logic
Syntax
English
LLMs
Automation
Scripting
Customer Support
We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs for accuracy, clarity, and alignment with project guidelines.
JSON
Sourcing
Accuracy
+10
Alignment
Pronunciation
Formatting
Logic
Syntax
English
LLMs
Automation
Scripting
Customer Support
We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs for accuracy, clarity, and alignment with project guidelines.
JSON
Portuguese
Sourcing
+12
Accuracy
Alignment
Pronunciation
Formatting
Logic
Syntax
English
LLMs
Automation
Scripting
Customer Support
Brazilian Portuguese
We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs for accuracy, clarity, and alignment with project guidelines.
Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.
JSON
German
Sourcing
+11
Accuracy
Alignment
Pronunciation
Formatting
Logic
Syntax
English
LLMs
Automation
Scripting
Customer Support
We are sourcing independent contractor experts to review AI-generated coding and technical customer service outputs for accuracy, clarity, and alignment with project guidelines.
JSON
Sourcing
Formatting
+12
Accuracy
Communication
Dutch
French
German
Italian
Portuguese
Greek
English
Customer Support
Attention to Detail
Written communication
We are sourcing independent contractor experts to evaluate AI-generated technical and customer-facing outputs. The work combines language fluency, customer service judgment, and coding knowledge, with a focus on JSON structure, formatting accuracy, and response quality.
Programming
Algorithms
MATCH
+12
Git
Communication
Python
JavaScript
TypeScript
Java
C++
Go
Rust
SQL
Programming Languages
Software Development
Your job is to serve as the human quality bar for AI-generated code. You will review solutions to programming tasks ranging from simple algorithm problems to multi-file application scaffolding.
AI
Programming
Python
+12
JavaScript
TypeScript
Java
C++
SQL
Documentation
GitHub
Testing
Onboarding
Annotation
Calibration
Git
You will evaluate code generated by AI models. Each task shows you a programming prompt and one or more candidate solutions. Your job is to assess correctness, efficiency, readability, and adherence to best practices, then rank the solutions and write a brief justification.
Programming
AI
Python
+12
JavaScript
TypeScript
Java
C++
SQL
Documentation
GitHub
Testing
Algorithms
Communication
Go
Rust
You will evaluate code generated by AI models. Each task shows you a programming prompt and one or more candidate solutions. Your job is to assess correctness, efficiency, readability, and adherence to best practices, then rank the solutions and write a brief justification.