Evaluate AI-generated PRDs, product roadmaps, feature specifications, and product strategy materials using professional product management and product strategy expertise.
Product Launch / Experiment Readiness Evaluator
Job description
About the Role
Mercor is seeking experienced Product Launch and Experiment Readiness Evaluators to assess AI-generated work products for accuracy, rigor, presentation quality, and domain expertise.
Evaluators will review materials such as:
- Product launch plans
- Go-to-market strategies
- Experiment design documents
- Product readiness assessments
- Documents
- Spreadsheets
- Slide presentations
The role focuses on applying professional product management and experimentation expertise to grade and provide feedback on AI-generated outputs using structured evaluation criteria.
This is a fully remote, hourly contract opportunity.
What You'll Do
- Evaluate AI-generated artifacts using domain-specific quality rubrics
- Review outputs for:
- Strategic accuracy
- Product readiness
- Experimental rigor
- Presentation quality
- Identify:
- Factual errors
- Launch planning gaps
- Experiment design flaws
- Aesthetic issues
- Presentation deficiencies
- Assess the quality of:
- Product launch strategies
- A/B testing frameworks
- Experimentation plans
- Go-to-market readiness assessments
- Product success metrics
- Provide clear, structured written feedback
- Apply professional judgment to assess overall output quality and usefulness
Required Qualifications
- 5+ years of professional experience in:
- Product Management
- Product Operations
- Product Launches
- Growth Experimentation
- Go-to-Market Strategy
- Native or professional fluency in English
- Strong proficiency with:
- Microsoft Office
- Google Workspace
Presentation Software Experience
Candidates should be highly comfortable using:
- Google Slides
- Microsoft PowerPoint
Preferred Qualifications
- Master's degree or higher
- Advanced academic credentials from a reputable institution
- Additional expertise in:
- Product Analytics
- Growth Strategy
- A/B Testing
- Experiment Design
- Product Marketing
- User Research
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work
- Flexible schedule
- Weekly payments through Stripe or Wise
- Projects may be extended, shortened, or concluded based on business needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and evaluate frontier AI systems using human expertise.
Contributors work on projects that help improve AI performance across specialized professional domains through expert review and evaluation.
You will be redirected to the company's website to complete your application.