Help improve Shopify's AI assistant by reviewing merchant conversations, identifying SQL and segmentation errors, evaluating analytics queries, and providing structured feedback to enhance AI performance.
AI Coding Contributor
India
$20 – $20/hr
April 23, 2026
Job description
About the Role
We are seeking AI Coding Contributors to support AI model training by evaluating, improving, and refining AI-generated code and responses.
In this role, you will work directly with AI systems, helping improve their reasoning, coding accuracy, and problem-solving capabilities through structured feedback and evaluation.
Key Responsibilities
- Analyze AI-generated code and identify bugs or inconsistencies
- Evaluate and rank outputs based on correctness and efficiency
- Develop structured prompts and hints to improve AI performance
- Assess AI-generated responses for accuracy, relevance, and clarity
- Provide feedback to support reinforcement learning processes
- Assist in fine-tuning AI models using curated datasets
Requirements
- Minimum 1 year of experience in a product-based company or startup
- Bachelor’s degree or equivalent experience
- Proficiency in at least one language: Python, Java, JavaScript/TypeScript, or C++
- Ability to review and evaluate AI-generated code and text
- Strong analytical thinking and attention to detail
- Strong written English communication skills
Work Details
- Work Type: Fully remote
- Engagement: Freelance
- Schedule: ~20 hours per week (flexible)
Selection Process
- 15-minute introductory conversation
- Platform signup and 120-minute assessment
About the Opportunity
This role focuses on improving AI coding systems through human feedback, helping enhance code generation, reasoning, and problem-solving capabilities in real-world scenarios.
Apply now
You will be redirected to the company's website to complete your application.
Senior AI Interaction Evaluator (Codex / Claude Code) Contract | $50-200/hr | 10+ hrs/week | Project-based Roles open on a rolling basis - apply to join the talent bench and we’ll reach out when one matches.
Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.
What We're Researching We are running a paid project focused on creating and validating complex coding tasks for AI systems. The goal is to build realistic, self-contained software engineering problems that push the boundaries of automated coding agents.