Back to remote jobs

Generative AI Generalist

DataAnnotation.tech

LLM Evaluator (English) Contractor Ongoing
United States From $20/hr May 7, 2026

Job description

About the Role

Surge AI is hiring Generative AI Generalists to help train and improve advanced AI chatbot systems.

In this role, you will evaluate AI-generated responses, assess logical reasoning, provide writing and editing tasks, and help improve overall AI model quality and performance.

This is a flexible remote contractor opportunity open to candidates across the United States.

Key Responsibilities

AI Evaluation & Training

  • Evaluate AI-generated outputs for:
  • Correctness
  • Logic
  • Clarity
  • Performance
  • Measure chatbot progress and response quality
  • Identify weaknesses and inconsistencies in AI outputs
  • Help improve model reasoning and accuracy

Writing & Editing Tasks

  • Create writing and editing tasks for AI systems
  • Assess:
  • Writing quality
  • Factual accuracy
  • Instruction following
  • Overall coherence
  • Provide detailed evaluations and feedback

Research & Analysis

  • Apply domain expertise to evaluate complex responses
  • Analyze outputs across multiple subject areas
  • Maintain quality standards and consistency during reviews

Required Qualifications

  • Fluency in English (native or bilingual level)
  • Strong attention to detail
  • Demonstrated expertise in a relevant domain
  • Strong analytical and reasoning abilities
  • Ability to work independently

Preferred Qualifications

  • Bachelor’s degree:
  • Completed
  • In progress
  • Or equivalent experience
  • Familiarity with:
  • Generative AI
  • AI evaluation
  • LLMs
  • Prompt engineering

Benefits

  • Fully remote work
  • Flexible scheduling
  • Choose your own projects
  • Full-time or part-time availability
  • Hourly pay starting at $20+/hr
  • Performance bonuses for high-quality and high-volume work

Payment & Work Authorization

  • Payment handled via PayPal
  • Open only to applicants located in the United States
  • Independent contractor position

About Surge AI

Surge AI provides data labeling, reinforcement learning, and evaluation infrastructure used to train advanced AI systems and language models.

Apply now

You will be redirected to the company's website to complete your application.

Apply now

Stay in the loop.

One email per week, 5 hand-picked roles.