Remote contract opportunity for experienced software engineers to build scalable backend and full-stack applications using modern programming languages, cloud technologies, and distributed engineering workflows.
Software Engineer - BYOD
Job description
Mercor is seeking experienced software engineers with legal ownership over SWE-related work documents to contribute to advanced AI training and evaluation projects.
This role is focused on:
- Designing LLM prompts
- Evaluating AI model outputs
- Working on rubric-style engineering tasks
- Supporting frontier AI model training initiatives
Candidates with prior Mercor experience on rubric-based projects are strongly preferred.
Key Responsibilities
Design and refine LLM prompts for software engineering evaluation workflows
Evaluate AI-generated outputs for:
- Technical correctness
- Reasoning quality
- Alignment with task rubrics
Contribute expertise across software engineering and code evaluation scenarios
Work on rubric-style AI assessment tasks involving engineering workflows and technical judgment
Apply real-world software engineering experience to improve AI training quality
Collaborate remotely with AI research and evaluation teams
Maintain high standards of technical accuracy and analytical rigor
Required Skills & Qualifications
Professional software engineering experience
Legal ownership of SWE-related work documents or materials
Strong understanding of:
- Software engineering workflows
- Code evaluation
- Technical reasoning
- Prompt design
Confidence designing:
- LLM prompts
- Evaluation rubrics
- AI assessment criteria
Ability to evaluate AI-generated engineering outputs critically
Strong written communication and technical analysis abilities
Experience working independently in remote environments
Preferred Qualifications
Prior Mercor experience working on:
- Rubric-style tasks
- AI evaluation workflows
- LLM assessment projects
Background in:
- AI model evaluation
- SWE benchmark projects
- Technical content review
Contract & Payment Information
Independent contractor engagement
Fully remote and asynchronous work environment
Flexible scheduling
Weekly payments via:
- Stripe
- Wise
Projects may be:
- Extended
- Shortened
- Ended early
depending on project needs and performance.
Please note:
- H1-B and STEM OPT candidates are not currently supported
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier AI models using human expertise.
Contributors work directly on projects focused on improving and evaluating next-generation AI systems.
You will be redirected to the company's website to complete your application.