Review and validate AI-generated coding tasks used to train large language models. Seeking experienced software engineers with strong code review, testing, and technical evaluation skills across multiple programming languages.
College Software Engineering Expert
Remote (Global)
$40 – $60/hr
May 12, 2026
Job description
Job Description
AfterQuery is seeking College Software Engineering Experts to create and refine software development challenges for training AI models.
In this remote and flexible role, contributors will design and evaluate coding scenarios that test AI systems on their ability to interpret and apply advanced programming concepts and software engineering principles.
The work focuses on helping AI models navigate:
- Real-world software development
- Debugging workflows
- System design
- Technical reasoning
- Engineering best practices
This role combines rigorous software engineering knowledge with frontier AI training and evaluation work.
Why Apply
Competitive Compensation
- Earn $40–60/hour based on expertise and performance
Innovative Impact
- Work with a YC-backed startup building advanced AI datasets and evaluation systems
Flexible Engagement
- Fully remote and asynchronous work
- Flexible scheduling around coursework or other commitments
Responsibilities
Develop high-quality software engineering questions and coding challenges
Create scenarios covering topics such as:
- Algorithm design
- Debugging
- System architecture
- API design
- Performance optimization
- Testing strategies
Evaluate and validate AI-generated responses
Provide detailed technical feedback to ensure:
- Accuracy
- Correct reasoning
- Alignment with engineering best practices
Collaborate with software engineering experts to:
- Adjust difficulty levels
- Improve educational quality
- Refine evaluation criteria
Required Qualifications
Currently enrolled in or recently graduated from:
- Computer Science
- Software Engineering
- Related technical degree programs
Strong programming skills in one or more languages such as:
- Python
- Java
- C++
- JavaScript
Strong understanding of:
- Algorithms
- Data structures
- Software engineering fundamentals
Excellent:
- Analytical skills
- Written communication
- Verbal communication
- Attention to detail
Preferred Qualifications
Internship experience at technology companies or startups
Coursework or projects involving:
- Algorithms
- Systems design
- Databases
- Web development
- Machine learning
Open-source contributions or personal coding projects
Familiarity with:
- Git
- Testing frameworks
- Modern development tools
Familiarity with AI or machine learning applications is a plus
About AfterQuery
AfterQuery is a research lab exploring the boundaries of artificial intelligence through novel datasets and experimentation.
The company is backed by investors including:
- Y Combinator
- Box Group
AfterQuery supports leading AI labs through advanced evaluation and training initiatives.
Apply now
You will be redirected to the company's website to complete your application.
Evaluate and improve frontier AI coding models by reviewing realistic software engineering tasks, debugging outputs, and designing advanced coding evaluations.
Evaluate AI-generated code and design advanced programming tasks. High-paying remote role ($90–$120/hr).
Remote Coding Expert role focused on evaluating and improving AI-generated coding challenges and solutions.