What We're Researching We're hiring software engineers for an ongoing remote project focused on building robust evaluations for AI coding agents. Your expertise ensures these models can handle realistic, complex problems in a terminal environment.
Coding Expert
Job description
Join the team as a Coding Expert helping train next-generation AI systems through advanced software engineering expertise, code evaluation, debugging, and technical problem solving.
This role focuses on reviewing AI-generated code, designing coding challenges, improving code quality, and helping AI systems better understand real-world software development practices.
No prior AI experience is required — strong programming expertise and software engineering fundamentals are the primary focus.
Key Responsibilities
Review, assess, and refine AI-generated code for:
- Accuracy
- Efficiency
- Maintainability
- Performance
Create and solve:
- Complex coding challenges
- Real-world engineering scenarios
- Technical evaluation tasks
Develop robust test cases to evaluate model performance across diverse programming problems
Deliver:
- Constructive feedback
- Technical reasoning
- Improvement recommendations
to support AI model refinement.
Collaborate with cross-functional teams to establish:
- Coding standards
- Quality benchmarks
- Evaluation guidelines
Stay current with:
- Programming languages
- Frameworks
- AI-assisted development workflows
Document:
- Findings
- Best practices
- Technical recommendations
- Engineering insights
Required Skills & Qualifications
Master’s degree in Computer Science OR
Bachelor’s degree with 4+ years of strong coding experience
Strong proficiency in at least one major language:
- Python
- Java
- C++
- JavaScript
- Go
- Rust
Strong understanding of:
- Data structures
- Algorithms
- Problem solving
- Software engineering principles
Experience involving:
- Code review
- Debugging
- Clean code practices
- Technical optimization
Familiarity with modern frameworks and technologies including:
- React
- Node.js
- .NET
- PHP
- TypeScript
- HTML
- Angular
Excellent:
- Written communication
- Verbal communication
- Technical explanation abilities
Strong attention to detail and passion for high-quality engineering workflows
Preferred Qualifications
Experience involving:
- AI/ML
- LLMs
- Prompt engineering
- AI-assisted coding systems
Active GitHub or public coding portfolio
Background evaluating:
- AI coding assistants
- Large language models
- Automated code generation systems
Additional Information
This role offers software engineers an opportunity to contribute coding expertise, technical reasoning, and software development workflows toward improving advanced AI systems focused on programming and engineering tasks.
You will be redirected to the company's website to complete your application.