Create and evaluate psychology problems for AI training. Remote part-time role paying up to $78/hour.
Psychology Quality Assurance Lead (QAL)
Job description
Job Summary
As a Psychology Quality Assurance Lead (QAL), you will oversee quality, consistency, and contributor performance across psychology-focused AI training projects.
You will review AI-generated psychology content, mental-health-related responses, research summaries, behavioral guidance, and trainer/QA work to ensure outputs are accurate, ethical, research-informed, and aligned with project standards.
Your work will directly contribute to improving advanced AI systems by ensuring psychology training data is scientifically accurate, appropriately cautious, safe, and useful.
Key Responsibilities
Quality Monitoring
- Spot-check psychology-related tasks and QA outputs
- Identify recurring quality issues
- Provide actionable written feedback
- Escalate critical quality concerns
Psychology Content Review
- Review and evaluate psychology explanations, mental health content, research summaries, behavioral guidance, theory applications, safety-sensitive responses, and educational psychology content
- Assess work for psychological accuracy, theory application, research literacy, ethical awareness, mental-health safety, diagnostic caution, clarity, instruction adherence, and rubric compliance
Trainer & QA Communication
- Communicate guidelines, workflow changes, quality standards, psychology review requirements, and safety expectations
Contributor Support
- Answer questions involving psychological theories, research quality, evidence interpretation, ethical boundaries, mental-health safety, diagnostic limitations, and rubric interpretation
Activation Management
- Follow up with inactive contributors, track participation and engagement, escalate availability issues when needed
Documentation & Onboarding
- Create and maintain style guides, documentation, FAQs, quality notes, examples, calibration tasks, and onboarding resources
- Conduct onboarding and training sessions for contributors
Safety & Ethics Review
- Identify and flag unsafe mental-health advice, overdiagnosis, unsupported claims, flawed research interpretation, pseudoscience, stigmatizing language, inappropriate therapeutic recommendations, crisis-insensitive content, and overconfident psychological conclusions
Process Improvement
- Improve QA workflows and identify recurring quality gaps
- Develop scalable psychology-review processes
Required Qualifications
- Bachelor's, Master's, PhD, PsyD, or equivalent background in Psychology, Clinical Psychology, Counseling, Behavioral Science, Cognitive Science, Neuroscience, Social Work, Education, or related disciplines
- Strong English communication skills
- Minimum 3 years of experience in psychology research, clinical or counseling settings, behavioral science, teaching, academic writing, mental-health content review, psychological assessment, or related psychology workflows
- Strong understanding of psychological theories, research methods, cognitive psychology, social psychology, developmental psychology, abnormal psychology, ethics, evidence-based practice, and mental-health safety
- Ability to identify unsafe advice, unsupported claims, pseudoscience, poor research interpretation, diagnostic overreach, stigmatizing language, and ethical violations
Preferred Qualifications
- Experience with CBT, Developmental Psychology, Personality Psychology, trauma-informed communication, behavioral interventions, mental-health literacy, research design, and statistics
- Experience with AI training, data annotation, LLM evaluation, mental-health content review, psychology QA, and rubric-based evaluation
Why Join
- Help improve leading AI systems through psychology-focused quality assurance
- Flexible remote schedule
- Weekly payments
- Access to future opportunities through SME Careers' expert network
Selection Process
- AI Interview
- Domain Assessment
- Recruiter Interview
Important Note
There is currently no active project for this role. Qualified candidates will be added to the SME Careers expert network and contacted when psychology-related opportunities become available.
You will be redirected to the company's website to complete your application.