Seeking experienced marketing professionals with AI evaluation experience to design marketing tasks, evaluate LLM outputs, develop scoring rubrics, and improve the marketing reasoning capabilities of frontier AI models.
Marketing Expert
Job description
Role Overview
Mercor is partnering with a leading AI research organization to engage experienced Marketing experts to evaluate how effectively AI systems perform real-world marketing work.
Rather than producing marketing deliverables yourself, you will define what high-quality marketing looks like by creating task-specific grading criteria and evaluating AI-generated and human work using rigorous, evidence-based scoring.
This is a fully remote, hourly contract opportunity for experienced marketing professionals.
Key Responsibilities
Design Evaluation Criteria
- Develop precise, task-specific grading rubrics for real-world marketing deliverables, including:
- Creative briefs
- Campaign concepts
- Presentation decks
- Brand positioning frameworks
- Messaging strategies
- Advertising copy
- Video and audio scripts
- Integrated marketing campaigns
- Client presentations
Evaluate AI Outputs
- Review AI-generated and human marketing work against established evaluation criteria.
- Provide detailed written justifications supporting every score.
Ensure Consistent Quality
- Apply objective, evidence-based judgment to ensure evaluations are reproducible, consistent, and defensible.
Improve Evaluation Standards
- Incorporate structured feedback from senior reviewers.
- Continuously refine grading approaches and evaluation quality.
Required Qualifications
5+ years of professional experience in marketing, advertising, or brand strategy.
Experience in roles such as:
- Creative Director
- Brand Strategist
- Account Director
- Marketing Manager
- Senior Brand Marketing Professional
Experience at leading creative agencies or major consumer brands is highly preferred.
Deep expertise in:
- Creative brief development
- Campaign strategy
- Brand positioning
- Brand messaging
- Multi-channel marketing
- Creative evaluation
- Client presentations
Strong understanding of evaluating creative work against business objectives and campaign briefs.
Exceptional written communication skills with the ability to clearly explain why marketing work meets—or fails to meet—professional standards.
Strong analytical thinking with excellent attention to detail.
Comfortable working in calibration and peer-review environments.
Previous experience with AI evaluation, RLHF, data annotation, or AI training projects is a strong advantage.
Note: A specialized background in media planning or marketing measurement is not required.
Compensation
- $80–$150 per hour
Work Arrangement
- Independent Contractor
- Fully Remote
- Flexible schedule
- Weekly payments via Stripe or Wise
Application Process
- Submit your resume or professional background.
- Qualified applicants may complete a brief assessment or provide additional information.
About Mercor
Mercor connects experienced professionals with leading AI laboratories to help train and evaluate frontier AI systems. Contributors work on high-impact AI research projects while enjoying flexible remote work and competitive compensation.
You will be redirected to the company's website to complete your application.