Remote opportunity for experienced software engineers and data science professionals to create benchmark tasks, evaluation rubrics, and ground-truth datasets used to assess frontier AI systems on technical document understanding and instruction following.
Python SWE
Job description
Mercor is recruiting experienced Python Software Engineers for a model-training project with a leading foundation-model AI laboratory.
This project focuses on applying advanced Python engineering expertise to help train and improve frontier AI systems.
The ideal candidate has experience building and maintaining production-grade Python systems, services, frameworks, and applications used in real-world environments.
Key Responsibilities
Contribute Python expertise to AI model training and evaluation projects
Work with complex, production-grade Python codebases
Design and maintain:
- Modular architectures
- Testable systems
- Scalable services
Apply advanced Python engineering practices across development and review workflows
Support the creation and evaluation of high-quality technical data used to improve AI systems
Required Qualifications
Professional Experience
- Experience working at leading technology companies is strongly preferred
- Proven experience building and maintaining production-grade Python systems
Advanced Python Expertise
Strong knowledge of:
- Decorators
- Generators
- Async/Await
- Context Managers
- Memory Optimization
- Performance Profiling
- Python Internals
Modern Python Development
Experience with:
- FastAPI
- Pydantic
- Type Hints
- Dependency Injection
- Unit Testing
- Integration Testing
Software Engineering Skills
- Designing modular codebases
- Writing maintainable and testable software
- Debugging and performance optimization
- Production system architecture
Interview Process
- 90-minute technical interview conducted by a human interviewer
- AI IDEs are not permitted during the interview
- LLMs and Stack Overflow may be allowed according to project guidelines
- Applicants typically receive feedback within two weeks
Project Expectations
- Approximately 20 hours per week
- Contract duration expected to be at least one month
- Strong performance may lead to future Mercor opportunities
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work
- Flexible schedule
- Weekly payments through Stripe or Wise
- Projects may be extended or shortened depending on project needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and evaluate frontier AI systems using expert human knowledge.
Contributors collaborate with researchers and engineers to help improve the next generation of advanced AI models.
You will be redirected to the company's website to complete your application.