Seeking senior product and visual designers with 4+ years of experience to evaluate AI-generated designs and provide expert feedback on layout, typography, color, visual hierarchy, and overall design quality.
Design Expert
Remote (Global)
$80 – $150/hr
July 11, 2026
Job description
Mercor is partnering with a leading AI research organization to engage experienced design professionals for a project focused on evaluating how well AI systems perform real-world design work. Rather than creating deliverables, you will define what excellent design looks like by developing evaluation criteria and scoring AI- and human-generated work with detailed, evidence-based feedback.
This is a flexible, remote contract opportunity for experienced graphic, brand, and visual designers interested in helping improve next-generation AI systems.
Key Responsibilities
Design Evaluation Frameworks
- Create precise, task-specific grading criteria for real-world design deliverables, including:
- Brand identity systems and guidelines
- Marketing and campaign visuals
- Presentation and layout design
- Packaging concepts
- Digital and social media assets
Evaluate Design Quality
- Review AI-generated and human-created design work.
- Score submissions against structured evaluation rubrics.
- Provide detailed written justifications explaining every score.
Maintain Evaluation Consistency
- Apply objective, evidence-based judgment to ensure evaluations are consistent, reproducible, and defensible.
- Incorporate structured feedback from senior reviewers and continuously improve evaluation quality.
Required Qualifications
5+ years of professional experience in graphic design, visual design, or brand design.
Experience working at:
- World-class creative agencies or design studios, or
- Senior design roles at leading consumer or technology companies.
Strong expertise in:
- Typography
- Layout and visual hierarchy
- Color theory
- Composition
- Brand systems
- Professional design critique
Excellent written communication skills with the ability to clearly explain design decisions and evaluation outcomes.
Strong attention to detail and the ability to apply evaluation standards consistently.
Preferred Qualifications
Experience with AI evaluation, AI training, RLHF, or human feedback projects.
Previous experience reviewing or mentoring design work.
Compensation
- $80–$150 USD per hour
Work Arrangement
- Remote
- Independent contractor
- Flexible schedule
- Weekly payments via Stripe or Wise
Apply now
You will be redirected to the company's website to complete your application.
DataAnnotation is seeking Design System Specialists to help train and improve next-generation AI models. In this role, contributors evaluate how AI systems understand, generate, and assess design work across areas such as interfaces, layouts, visuals, and user experiences.…
About the Role We are seeking Design Experts to support AI model training by designing complex design workflows and evaluating AI-generated outputs. In this role, you will create realistic scenarios across visual design, product design, and creative operations, and assess how…