We’re looking for highly experienced software engineer to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code. This is not a traditional engineering role. You won’t be writing production code.
AI Coding Contributor
Job description
About the Role
We are seeking AI Coding Contributors to support AI model training by evaluating, improving, and refining AI-generated code and responses.
In this role, you will work directly with AI systems, helping improve their reasoning, coding accuracy, and problem-solving capabilities through structured feedback and evaluation.
Key Responsibilities
- Analyze AI-generated code and identify bugs or inconsistencies
- Evaluate and rank outputs based on correctness and efficiency
- Develop structured prompts and hints to improve AI performance
- Assess AI-generated responses for accuracy, relevance, and clarity
- Provide feedback to support reinforcement learning processes
- Assist in fine-tuning AI models using curated datasets
Requirements
- Minimum 1 year of experience in a product-based company or startup
- Bachelor’s degree or equivalent experience
- Proficiency in at least one language: Python, Java, JavaScript/TypeScript, or C++
- Ability to review and evaluate AI-generated code and text
- Strong analytical thinking and attention to detail
- Strong written English communication skills
Work Details
- Work Type: Fully remote
- Engagement: Freelance
- Schedule: ~20 hours per week (flexible)
Selection Process
- 15-minute introductory conversation
- Platform signup and 120-minute assessment
About the Opportunity
This role focuses on improving AI coding systems through human feedback, helping enhance code generation, reasoning, and problem-solving capabilities in real-world scenarios.
Opens docs.google.com in a new tab. If they ask how you found the role, mention RemoWork.