We need evaluators who can read AI-generated text critically and make consistent quality judgments under detailed rubrics. On a given day you might compare two explanations of quantum mechanics, two pieces of marketing copy, and two responses to a sensitive personal question.
Remote Evaluation & Quality Jobs in Costa Rica 2026
170 remote jobs open to candidates in Costa Rica in Evaluation & Quality. Updated daily.
This role is adversarial by design. You will probe language models for weaknesses by writing creative, unusual, and sometimes uncomfortable prompts designed to surface failure modes.
We need people who can think like attackers. You will methodically test AI models against a taxonomy of failure modes: harmful content generation, jailbreak susceptibility, PII leakage, bias amplification, and more.
We need evaluators who can read AI-generated text critically and make consistent quality judgments under detailed rubrics. On a given day you might compare two explanations of quantum mechanics, two pieces of marketing copy, and two responses to a sensitive personal question.
You will evaluate code generated by AI models. Each task shows you a programming prompt and one or more candidate solutions. Your job is to assess correctness, efficiency, readability, and adherence to best practices, then rank the solutions and write a brief justification.
You will audit completed annotations produced by other team members, checking each one against the project rubric and flagging errors.
You will audit completed annotations produced by other team members, checking each one against the project rubric and flagging errors.
This role is about making judgment calls on AI output quality. You will see prompts across a wide range of topics -- math, coding, creative writing, factual questions, safety scenarios -- and rate the corresponding model responses on dimensions like helpfulness, truthfulness,…
Quality review sits between the annotation team and the client. You will sample completed batches, apply the scoring rubric, and produce accuracy reports that the project lead uses to give feedback to annotators.
You will sit at the intersection of AI training and human judgment. Each task presents a prompt-response pair (or set of pairs) that you evaluate against a detailed rubric covering accuracy, helpfulness, safety, and style.
We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains.
Rise Data Labs builds high-fidelity data services to power AI systems. We partner with leading research teams and industry stakeholders to improve model quality through human oversight, evaluation, and annotation.
Directly responsible for improving the quality, safety, and intelligence of cutting-edge AI models. Key Responsibilities Create High-Quality Training Data: Write, edit, and refine clear, accurate, and engaging prompts and responses on a diverse range of topics.
We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.
A well-established company that is leveraging the advanced power of technology to help realize the science-fiction fantasy of collaborative and open-ended computer dialogues, is looking for Go develoeprs.
Freelance position for SMEs to provide review on translation projects processed at Argos Multilingual. SME Review tesk: Monolingual review of the subject content/terminology in the target text by a product expert (end user of the specific device, product manager, application…
We are looking for a freelance SME reviewer to handle the review of medical/technical/finance/legal/recruitment-related for our client from HR industry and I want to check if this request of ours is a good fit for you. Please note that we are interested in regular collaboration.
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.
Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems.
We are currently looking for long-term participants for our new project, Lightspeed! If you are familiar with our Milky Way project, this is the next logical step to conquer the universe!
A well-established company that is leveraging the advanced power of technology to help realize the science-fiction fantasy of collaborative and open-ended computer dialogues, is looking for C++ develoeprs.
Turing’s goal is to accelerate Artificial Generative AI advancement and its deployment in the world. We believe powerful and widely deployed AGI is key to unleashing the world’s untapped human potential.
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.