Programming
Algorithms
MATCH
+12
Git
Communication
Python
JavaScript
TypeScript
Java
C++
Go
Rust
SQL
Programming Languages
Software Development
Your job is to serve as the human quality bar for AI-generated code. You will review solutions to programming tasks ranging from simple algorithm problems to multi-file application scaffolding.
Make
Rubrics
Mechanics
+12
Marketing
AI
RLHF
Annotation
Onboarding
Training
Calibration
Slack
Linguistics
Philosophy
STEM
Workday
We need evaluators who can read AI-generated text critically and make consistent quality judgments under detailed rubrics. On a given day you might compare two explanations of quantum mechanics, two pieces of marketing copy, and two responses to a sensitive personal question.
RLHF
Make
Rubrics
+12
Mechanics
Marketing
Education
Research
Writing
Analysis
Onboarding
Training
Calibration
Slack
Linguistics
Philosophy
We need evaluators who can read AI-generated text critically and make consistent quality judgments under detailed rubrics. On a given day you might compare two explanations of quantum mechanics, two pieces of marketing copy, and two responses to a sensitive personal question.
Annotation
Accuracy
Editing
+12
Engineering
Research
Rubrics
Cadence
Monday.com
Calibration
Slack
Documentation
Quality Assurance
Analysis
Quality Review
Test Engineering
Quality review sits between the annotation team and the client. You will sample completed batches, apply the scoring rubric, and produce accuracy reports that the project lead uses to give feedback to annotators.
AI
Cybersecurity
Testing
+12
Machine Learning
Journalism
Writing
Onboarding
Reporting
Slack
Engineering
Research
Analysis
Safety Evaluation
Penetration Testing
Creative Writing
We need people who can think like attackers. You will methodically test AI models against a taxonomy of failure modes: harmful content generation, jailbreak susceptibility, PII leakage, bias amplification, and more.
Annotation
Audit
Writing
+12
Editing
Engineering
Research
Rubrics
Cadence
Monday.com
Calibration
Slack
English
Analysis
Assurance
Communication
You will audit completed annotations produced by other team members, checking each one against the project rubric and flagging errors.
AI
Programming
Python
+12
JavaScript
TypeScript
Java
C++
SQL
Documentation
GitHub
Testing
Onboarding
Annotation
Calibration
Git
You will evaluate code generated by AI models. Each task shows you a programming prompt and one or more candidate solutions. Your job is to assess correctness, efficiency, readability, and adherence to best practices, then rank the solutions and write a brief justification.
Alignment
Make
Rubrics
+12
Mechanics
Marketing
Writing
Philosophy
Journalism
Education
RLHF
Calibration
Annotation
English
Communication
Workday
We need evaluators who can read AI-generated text critically and make consistent quality judgments under detailed rubrics. On a given day you might compare two explanations of quantum mechanics, two pieces of marketing copy, and two responses to a sensitive personal question.
AI
Writing
Infrastructure
+12
Creativity
Cybersecurity
Testing
Machine Learning
Journalism
Engineering
Research
Analysis
Onboarding
AI Safety
Language Models
Network Infrastructure
This role is adversarial by design. You will probe language models for weaknesses by writing creative, unusual, and sometimes uncomfortable prompts designed to surface failure modes.
AI
Cybersecurity
Testing
+12
Machine Learning
Journalism
Writing
Communication
Reporting
Documentation
Engineering
Onboarding
Penetration Testing
Creative Writing
Written communication
AI Safety
We need people who can think like attackers. You will methodically test AI models against a taxonomy of failure modes: harmful content generation, jailbreak susceptibility, PII leakage, bias amplification, and more.
AI
Make
Rubrics
+12
Mechanics
Marketing
RLHF
Annotation
Accuracy
English
Communication
Linguistics
Philosophy
STEM
Education
Writing
We need evaluators who can read AI-generated text critically and make consistent quality judgments under detailed rubrics. On a given day you might compare two explanations of quantum mechanics, two pieces of marketing copy, and two responses to a sensitive personal question.
Programming
AI
Python
+12
JavaScript
TypeScript
Java
C++
SQL
Documentation
GitHub
Testing
Algorithms
Communication
Go
Rust
You will evaluate code generated by AI models. Each task shows you a programming prompt and one or more candidate solutions. Your job is to assess correctness, efficiency, readability, and adherence to best practices, then rank the solutions and write a brief justification.
Audit
Writing
Annotation
+12
Combine
Precision
Communication
Cadence
Monday.com
Calibration
Slack
Rubrics
Editing
Research
Analysis
Quality Assurance
You will audit completed annotations produced by other team members, checking each one against the project rubric and flagging errors.
Quality Assurance
AI
Training
+12
Audit
Writing
Annotation
Editing
Engineering
Research
Rubrics
Flexible
Assurance
Documentation
Analysis
Communication
You will audit completed annotations produced by other team members, checking each one against the project rubric and flagging errors.
AI
Writing
Education
+12
Research
Analysis
Calibration
English
Communication
RLHF
Workday
Onboarding
Accuracy
Creative Writing
Professional Experience
Technical Writing
This role is about making judgment calls on AI output quality. You will see prompts across a wide range of topics -- math, coding, creative writing, factual questions, safety scenarios -- and rate the corresponding model responses on dimensions like helpfulness, truthfulness,…
Annotation
Audit
Accuracy
+12
Quality Assurance
Editing
Proofreading
Rubrics
Assurance
Documentation
Research
Analysis
Quality Review
Annotation Review
Written Feedback
Data Analysis
Quality review sits between the annotation team and the client. You will sample completed batches, apply the scoring rubric, and produce accuracy reports that the project lead uses to give feedback to annotators.
AI
Training
Accuracy
+12
Education
Research
Writing
Analysis
Calibration
Linguistics
Philosophy
STEM
Rubrics
Annotation
Workday
Response Ranking
You will sit at the intersection of AI training and human judgment. Each task presents a prompt-response pair (or set of pairs) that you evaluate against a detailed rubric covering accuracy, helpfulness, safety, and style.
AI
Research
Analytics
+9
Analysis
Planning
Accuracy
Flexible
English
Writing
Financial Analysis
Business Intelligence
Attention to Detail
We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains.
AI
Research
Microsoft Teams
+12
Annotation
Rubrics
Collaboration
Alignment
Confidentiality
Labelbox
Assurance
Machine Learning
Flexible
Generative AI
Data Services
Structured Feedback
Rise Data Labs builds high-fidelity data services to power AI systems. We partner with leading research teams and industry stakeholders to improve model quality through human oversight, evaluation, and annotation.
AI
Training
Accuracy
+12
Fact-Checking
Research
English
Writing
Grammar
Communication
History
Culture
Journalism
Communications
Linguistics
STEM
Directly responsible for improving the quality, safety, and intelligence of cutting-edge AI models. Key Responsibilities Create High-Quality Training Data: Write, edit, and refine clear, accurate, and engaging prompts and responses on a diverse range of topics.
AI
Testing
Analysis
+9
Accuracy
Machine Learning
Communication
AI Model Evaluation
Model Evaluation
Evaluation Frameworks
Computer Science
Statistical Analysis
Communication Skills
We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.
A well-established company that is leveraging the advanced power of technology to help realize the science-fiction fantasy of collaborative and open-ended computer dialogues, is looking for Go develoeprs.
Finnish
Translation
Documentation
+12
Education
Life Sciences
Healthcare
Procedures
Research
Accuracy
Communication
Management
Linguistic Review
Medical Documentation
Research Skills
Communication Skills
Freelance position for SMEs to provide review on translation projects processed at Argos Multilingual. SME Review tesk: Monolingual review of the subject content/terminology in the target text by a product expert (end user of the specific device, product manager, application…
Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems.
