Curated remote opportunities

Remote Agent System Evaluator jobs

Every Agent System Evaluator listing below is remote and traceable to a real, verified employer. 31 open right now, updated daily; when a role goes stale it comes down within 24 hours.

Agent System Evaluator is part of our LLM & Agent Evaluation domain. Filter by pay, experience level, or country to narrow the list.

Filters

6 remote jobs found
Agent System Evaluator Freelancer · Part-time ↘ +43 regions
English AI Testing +12 Infrastructure History Quality Assurance Engineering Writing Python FastAPI JavaScript TypeScript React Docker PostgreSQL
  • Germany, Poland, South Korea, Japan, Estonia, Latvia, Lithuania, Czech Republic, India, Mexico, Chile, Colombia, Costa Rica, Peru, Uruguay, Argentina, Brazil, Philippines, Singapore, Malaysia, New Zealand, Saudi Arabia, Qatar, Kuwait, Jordan, Turkey, Israel, South Africa, Romania, Greece, Hungary, Austria, Ireland, Belgium, Denmark, Finland, Norway, Sweden, Portugal, Italy, France, Spain, Australia
  • $50/hr
  • Jul 6, 2026

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

View Details
Agent System Evaluator Contractor · Full-time
LLM Evaluation Quality Assurance Technical Writing +10 Process Improvement Attention to Detail Rubric Development Structured Observation Research Analysis Documentation SaaS Tools Evaluation Frameworks English Communication Reporting
  • Remote (Global)
  • $20 - $35/hr
  • May 30, 2026

As an AI Evaluation Specialist, you will help train and evaluate next-generation AI systems by designing evaluation tasks, creating grading rubrics, and assessing AI performance across real-world computer-based workflows. This role focuses on structured thinking, precise…

LLM Evaluation Gameplay Testing Bug Reporting +7 Usability Testing Critical Thinking Attention to Detail Technical Writing PC Gaming WASD Navigation Environment Analysis
  • United States (US: AZ, CA, NV +2)
  • $6 – $65/hr
  • May 2, 2026

Are you an experienced PC gamer eager to help shape the future of AI? Large-scale language models are expanding beyond text into interactive, AI-generated environments capable of simulating dynamic virtual worlds. With high-quality human feedback, these systems can improve…

Spoken English Voice Communication Conversational Analysis +10 AI Model Evaluation Speech-to-Speech Interaction User Experience Evaluation Attention to Detail Written Feedback Data Annotation (AI) Quality Assurance Instruction Following Critical Thinking Listening Comprehension
  • United States
  • Mar 11, 2026

About the Role SME Careers is seeking Speech-to-Speech English Voice AI Testers to help evaluate conversational AI systems through real-time voice interactions. In this role, you will engage in short, natural conversations with an AI model and then assess the model’s…

Tips for finding remote jobs

  • Set up job alerts on multiple platforms to never miss an opportunity.
  • Highlight your remote work experience and self-management skills.
  • Prepare for video interviews and remote work assessments.
  • Customize your resume and cover letter for each remote position.
  • Build a strong online presence on LinkedIn and professional networks.

Stay in the loop.

One email per week, 5 hand-picked roles.