Back to remote jobs

Software Engineer - BYOD

Mercor

AI Expert - Software Engineering Contractor
Remote (Global) $150 – $200/hr May 13, 2026

Job description

Mercor is seeking experienced software engineers with legal ownership over SWE-related work documents to contribute to advanced AI training and evaluation projects.

This role is focused on:

  • Designing LLM prompts
  • Evaluating AI model outputs
  • Working on rubric-style engineering tasks
  • Supporting frontier AI model training initiatives

Candidates with prior Mercor experience on rubric-based projects are strongly preferred.

Key Responsibilities

  • Design and refine LLM prompts for software engineering evaluation workflows

  • Evaluate AI-generated outputs for:

    • Technical correctness
    • Reasoning quality
    • Alignment with task rubrics
  • Contribute expertise across software engineering and code evaluation scenarios

  • Work on rubric-style AI assessment tasks involving engineering workflows and technical judgment

  • Apply real-world software engineering experience to improve AI training quality

  • Collaborate remotely with AI research and evaluation teams

  • Maintain high standards of technical accuracy and analytical rigor

Required Skills & Qualifications

  • Professional software engineering experience

  • Legal ownership of SWE-related work documents or materials

  • Strong understanding of:

    • Software engineering workflows
    • Code evaluation
    • Technical reasoning
    • Prompt design
  • Confidence designing:

    • LLM prompts
    • Evaluation rubrics
    • AI assessment criteria
  • Ability to evaluate AI-generated engineering outputs critically

  • Strong written communication and technical analysis abilities

  • Experience working independently in remote environments

Preferred Qualifications

  • Prior Mercor experience working on:

    • Rubric-style tasks
    • AI evaluation workflows
    • LLM assessment projects
  • Background in:

    • AI model evaluation
    • SWE benchmark projects
    • Technical content review

Contract & Payment Information

  • Independent contractor engagement

  • Fully remote and asynchronous work environment

  • Flexible scheduling

  • Weekly payments via:

    • Stripe
    • Wise
  • Projects may be:

    • Extended
    • Shortened
    • Ended early

depending on project needs and performance.

Please note:

  • H1-B and STEM OPT candidates are not currently supported

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier AI models using human expertise.

Contributors work directly on projects focused on improving and evaluating next-generation AI systems.

Apply now

You will be redirected to the company's website to complete your application.

Apply now

Stay in the loop.

One email per week, 5 hand-picked roles.