The United States, India
$12.19/hr
February 24, 2026
Job Description
Why This Role Exists
Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems.
This project focuses on evaluating and improving general chat behavior in large language models (LLMs). You will assess AI-generated responses across diverse topics and provide structured human feedback to ensure outputs are accurate, well-reasoned, and aligned with human expectations.
What You’ll Do
Advertisement
- Evaluate LLM-generated responses for clarity, correctness, and completeness.
- Conduct fact-checking using trusted public sources and verification tools.
- Annotate strengths, weaknesses, and factual inaccuracies.
- Assess reasoning quality, tone, and conversational alignment.
- Ensure outputs comply with system guidelines and expected behavior.
- Apply consistent annotations using structured taxonomies and evaluation rubrics.
Who You Are
- Bachelor’s degree holder.
- Native Hindi speaker or ILR 5 / C2 proficiency.
- Fluent in English.
- Experienced user of large language models (LLMs).
- Strong writing skills with ability to provide nuanced feedback.
- Highly detail-oriented and analytical.
- Comfortable working across diverse topics and domains.
- Strong college-level mathematics skills.
Nice-to-Have
Advertisement
- Experience with RLHF, model evaluation, or annotation workflows.
- Experience comparing multiple outputs and making fine-grained qualitative judgments.
- Familiarity with evaluation rubrics and benchmarking systems.
- Background in research, analytics, linguistics, or engineering.
What Success Looks Like
- You consistently identify factual inaccuracies and reasoning gaps.
- Your evaluation artifacts are clear, consistent, and reproducible.
- Your feedback leads to measurable improvements in AI response quality.
- AI systems improve before public deployment due to your evaluations.
Contract & Payment
- Independent contractor engagement.
- Fully remote with flexible schedule.
- Weekly payments via Stripe or Wise.
- Geography restricted to India and USA.
- $12.19 per hour.
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. Contributors collaborate with researchers to improve advanced AI systems used globally.
Apply Now
You will be redirected to the company's website to complete your application.
Job Summary
Company
Mercor
Location
The United States, India
Type
Full-time
Category
Linguistics & Translation
Salary
$12.19/hr
Categories
Explore other opportunities in related specializations:
Related Jobs
View AllEnglish Conversation Partner for AI Training
Babel Audio
•
Linguistics & Translation
$17.50 per recorded hour
Arabic Copyeditor Expert (Native Fluency)
Mercor
•
Linguistics & Translation
$35/hr
Portuguese Copyeditor Expert (Native Fluency)
Mercor
•
Linguistics & Translation
$37.5/hr
Spanish Copyeditor Expert (Native Fluency)
Mercor
•
Linguistics & Translation
$37.5/hr
Mercor
Discover more opportunities that match your skills and interests.
Frequently Asked Questions
Is Mercor legitimate?
Yes, Mercor is a legitimate company listed on RemoWork. We verify all companies on our platform. However, we always recommend doing your own research before sharing personal information or starting work. Check reviews from other users and visit the company's official website for the most up-to-date information.
How do I get started with Mercor?
To get started, visit Mercor's official website and look for their careers or sign-up page. Create an account, complete your profile with relevant skills and experience, and apply for available positions or projects. Some companies may require you to pass a qualification test or assessment before you can start working.
Does Mercor offer remote work?
Yes, Mercor offers remote work opportunities. Most tasks and positions can be completed from anywhere with a reliable internet connection and a computer or smartphone. Specific location requirements may vary by project or role, so check individual listings for details.
How does Mercor pay its workers?
Payment methods and schedules vary. Common payment options include PayPal, bank transfers, Payoneer, and other digital payment platforms. Visit Mercor's official website or check their payment/FAQ section for specific details about payment methods, minimum thresholds, and payout schedules.
What skills do I need to work with Mercor?
Required skills vary by role and project. Generally, you'll need a reliable internet connection, basic computer literacy, strong attention to detail, and good communication skills. Some positions may require specialized expertise, language proficiency, or technical qualifications. Check individual job listings for specific requirements.
What is Mercor's vetting process like?
Mercor uses an AI-powered vetting process that evaluates candidates through technical assessments, interviews, and skill verification. The platform matches vetted talent with companies looking for specific expertise. The process is designed to be efficient and identify top-tier professionals quickly.
What types of roles does Mercor offer?
Mercor connects professionals with AI engineering, software development, data science, machine learning, and other tech-focused roles. The platform works with startups and enterprises, offering both contract and full-time remote positions across various technical domains.
Is Mercor free for job seekers?
Yes, Mercor is free for job seekers and freelancers. The platform earns revenue from companies hiring through the network. Candidates can create profiles, get vetted, and apply for positions at no cost.