Remote
$80 - $120/Day
December 17, 2025
Job Description
About the Role
Build reproducible, standardized test environments using Docker images to accurately replicate known issues or generate expected outputs according to specified procedures.
What You'll Do
Advertisement
- Review and enhance the coverage and effectiveness of existing unit tests to assess the correctness and stability of target code.
- Validate the completeness and rationality of test sets, ensuring that workflows for tasks related to SWE-Bench and Terminal-Bench are precisely aligned.
- Write high-quality task documentation (task.yaml/README), emphasizing reproducibility and standardized processes.
Who We're Looking For
Required Skills:
- Proficient in Linux command line and Shell scripting, skilled with tools like grep, sed, awk, curl, jq.
- Expert in Python programming for writing task harnesses, test cases, and automation tools.
- Proficient with Docker, including writing Dockerfiles and building reproducible environments.
- Familiar with testing frameworks like pytest, capable of writing structured unit tests and using techniques for mocking data and controlling randomness.
- Familiar with Git/GitHub workflows, able to submit high-quality, reproducible pull requests.
Advertisement
Professional Background:
- Background in Computer Science, Software Engineering, Artificial Intelligence, or related fields; or experience in roles such as Software Development, Test Engineering, DevOps, or Data Engineering.
- Contributors to open-source projects (especially in automated testing, CI/CD, containerization) are preferred.
Bonus Points:
- Proficiency in high-performance languages like Go or Rust.
- Familiarity with other sandbox technologies like Docker Compose or Podman.
- Ability to design datasets/tasks that prevent "task cheating."
- Understanding of scientific benchmark design principles (fairness, repeatability, scalability).
- Experience with automated testing systems or CI/CD, and a cross-disciplinary perspective.
Compensation
USD $80 - 120/Day, dependent on actual skills and experience.
Apply Now
You will be redirected to the company's website to complete your application.
Job Summary
Company
RemoExperts
Location
Remote
Type
Contract
Category
Computer Science & Engineering
Salary
$80 - $120/Day
Categories
Explore other opportunities in related specializations:
Related Jobs
View AllProfessional Domain Expert (Technology)
Mercor
•
Computer Science & Engineering
$40 – $60/hr
Game Developer (Engines)
Micro1
•
Computer Science & Engineering
$80 – $120/hr
Game Dev (Frameworks)
Micro1
•
Computer Science & Engineering
$80 – $120/hr
Cybersecurity Experts
Mercor
•
Computer Science & Engineering
$80 – $120/hr
RemoExperts
Discover more opportunities that match your skills and interests.
Frequently Asked Questions
Is RemoExperts legitimate?
Yes, RemoExperts is a legitimate company listed on RemoWork. We verify all companies on our platform. However, we always recommend doing your own research before sharing personal information or starting work. Check reviews from other users and visit the company's official website for the most up-to-date information.
How do I get started with RemoExperts?
To get started, visit RemoExperts's official website and look for their careers or sign-up page. Create an account, complete your profile with relevant skills and experience, and apply for available positions or projects. Some companies may require you to pass a qualification test or assessment before you can start working.
Does RemoExperts offer remote work?
Yes, RemoExperts offers remote work opportunities. Most tasks and positions can be completed from anywhere with a reliable internet connection and a computer or smartphone. Specific location requirements may vary by project or role, so check individual listings for details.
How does RemoExperts pay its workers?
Payment methods and schedules vary. Common payment options include PayPal, bank transfers, Payoneer, and other digital payment platforms. Visit RemoExperts's official website or check their payment/FAQ section for specific details about payment methods, minimum thresholds, and payout schedules.
What skills do I need to work with RemoExperts?
Required skills vary by role and project. Generally, you'll need a reliable internet connection, basic computer literacy, strong attention to detail, and good communication skills. Some positions may require specialized expertise, language proficiency, or technical qualifications. Check individual job listings for specific requirements.
What makes RemoExperts different from other freelance platforms?
RemoExperts focuses specifically on connecting domain experts with AI training and evaluation projects. Unlike general freelance platforms, RemoExperts emphasizes subject matter expertise and curates projects that require specialized knowledge, ensuring higher-quality matches between experts and AI companies.
What domains does RemoExperts cover?
RemoExperts covers a wide range of expert domains including technology, healthcare, law, finance, education, linguistics, creative writing, engineering, and scientific research. The platform is constantly expanding its domain coverage as AI companies require diverse expertise.
How are projects assigned on RemoExperts?
Projects on RemoExperts are matched based on your profile, domain expertise, qualifications, and availability. After creating a profile and verifying your credentials, you'll receive notifications about relevant projects. You can review project details and choose to accept assignments that align with your expertise.