Job Summary
Join our customer’s team as a Product Validation Expert and play a critical role in ensuring a widely used AI-powered consumer product delivers safe, accurate, and helpful user experiences.
In this role, you will design and implement structured evaluation processes to assess user perceptions, identify risks, and translate findings into actionable product improvements.
Key Responsibilities
- Design and develop robust evaluation rubrics focused on AI model outputs from a user experience (UX) perspective.
- Analyze and execute validation tasks to identify potential issues that could negatively impact the user experience.
- Collaborate with cross-functional teams to define and refine validation criteria and safety standards.
- Translate user insights into actionable feedback to improve model accuracy, safety, and helpfulness.
- Document findings and recommendations clearly for stakeholders.
- Monitor evolving product usage patterns and proactively identify emerging UX risks or concerns.
Required Skills and Qualifications
- Exceptional written and verbal communication skills with strong clarity and precision.
- Ability to create and apply evaluation frameworks balancing UX, safety, and performance.
- Strong analytical mindset and attention to detail.
- Comfort working in collaborative, fast-changing project environments.
- Proficiency in documenting complex findings in user-friendly formats.
- Availability to commit at least 15 hours per week.
Preferred Qualifications
- Familiarity with widely used AI consumer products and common user journeys.
- Experience evaluating AI systems or digital products from a UX perspective.
Offer Details
- Job Type: Contract (Full-time or Part-time)
- Openings: 47
- Location: Remote
- Minimum Commitment: 15 hours per week