Software Engineering & Data Science Expert (Ruby, 5+ YOE)
Computer Science & Engineering
Contract
Remote
$60 – $100/hr
March 27, 2026
Job Description
Job Summary
Mercor is seeking Software Engineering, Data Science, and Systems Design Experts (Ruby) to evaluate and improve AI-generated coding outputs.
In this role, you will assess how well AI systems reason about code, solve technical problems, and explain complex engineering concepts. Your feedback will directly improve the reliability and quality of AI tools used by developers worldwide.
Key Responsibilities
Advertisement
- Evaluate AI-generated responses to coding and software engineering queries.
- Assess correctness, reasoning quality, clarity, and completeness.
- Execute and validate code to verify accuracy and outputs.
- Identify bugs, inefficiencies, and logical flaws in model-generated solutions.
- Analyze code quality, readability, and algorithmic soundness.
- Provide structured annotations highlighting strengths and areas for improvement.
- Ensure outputs align with engineering best practices and evaluation guidelines.
Requirements
- Bachelor’s, Master’s, or PhD in Computer Science or a related field.
- 5+ years of professional experience in software engineering or similar roles.
- Strong expertise in Ruby programming.
- Ability to solve medium to hard algorithmic problems (e.g., LeetCode/HackerRank).
- Experience contributing to open-source projects (with merged pull requests).
- Familiarity with using LLMs in coding workflows and understanding their limitations.
- Strong analytical skills and attention to detail.
Advertisement
Preferred Qualifications
- Experience with RLHF, AI evaluation, or annotation workflows.
- Background in competitive programming.
- Experience reviewing production-level code.
- Familiarity with multiple programming languages or paradigms.
- Ability to explain complex technical concepts clearly.
What Success Looks Like
- Identifying incorrect logic, edge cases, and inefficiencies in AI-generated code.
- Improving clarity, correctness, and robustness of AI outputs.
- Delivering consistent, high-quality evaluation insights.
Contract & Payment
- Employment Type: Contract (Freelance)
- Location: Remote (Worldwide)
- Pay: $60 – $100 per hour
- Payments are made weekly via Stripe or Wise.
Note: This is an independent contractor role. Project duration may vary based on performance and project needs.
Apply Now
You will be redirected to the company's website to complete your application.
Job Summary
Company
Mercor
Location
Remote
Type
Contract
Category
Computer Science & Engineering
Salary
$60 – $100/hr
Categories
Explore other opportunities in related specializations:
Related Jobs
View AllProfessional Domain Expert (Technology)
Mercor
•
Computer Science & Engineering
$40 – $60/hr
Game Developer (Engines)
Micro1
•
Computer Science & Engineering
$80 – $120/hr
Game Dev (Frameworks)
Micro1
•
Computer Science & Engineering
$80 – $120/hr
Cybersecurity Experts
Mercor
•
Computer Science & Engineering
$80 – $120/hr
Mercor
Discover more opportunities that match your skills and interests.
Frequently Asked Questions
Is Mercor legitimate?
Yes, Mercor is a legitimate company listed on RemoWork. We verify all companies on our platform. However, we always recommend doing your own research before sharing personal information or starting work. Check reviews from other users and visit the company's official website for the most up-to-date information.
How do I get started with Mercor?
To get started, visit Mercor's official website and look for their careers or sign-up page. Create an account, complete your profile with relevant skills and experience, and apply for available positions or projects. Some companies may require you to pass a qualification test or assessment before you can start working.
Does Mercor offer remote work?
Yes, Mercor offers remote work opportunities. Most tasks and positions can be completed from anywhere with a reliable internet connection and a computer or smartphone. Specific location requirements may vary by project or role, so check individual listings for details.
How does Mercor pay its workers?
Payment methods and schedules vary. Common payment options include PayPal, bank transfers, Payoneer, and other digital payment platforms. Visit Mercor's official website or check their payment/FAQ section for specific details about payment methods, minimum thresholds, and payout schedules.
What skills do I need to work with Mercor?
Required skills vary by role and project. Generally, you'll need a reliable internet connection, basic computer literacy, strong attention to detail, and good communication skills. Some positions may require specialized expertise, language proficiency, or technical qualifications. Check individual job listings for specific requirements.
What is Mercor's vetting process like?
Mercor uses an AI-powered vetting process that evaluates candidates through technical assessments, interviews, and skill verification. The platform matches vetted talent with companies looking for specific expertise. The process is designed to be efficient and identify top-tier professionals quickly.
What types of roles does Mercor offer?
Mercor connects professionals with AI engineering, software development, data science, machine learning, and other tech-focused roles. The platform works with startups and enterprises, offering both contract and full-time remote positions across various technical domains.
Is Mercor free for job seekers?
Yes, Mercor is free for job seekers and freelancers. The platform earns revenue from companies hiring through the network. Candidates can create profiles, get vetted, and apply for positions at no cost.