Philosophy Quality Assurance Lead (QAL)

Job Summary

As a Philosophy Quality Assurance Lead (QAL), you will oversee quality, consistency, and contributor performance across philosophy-focused AI training projects.

You will review AI-generated philosophy content, ethical analyses, logic problems, argument evaluations, summaries of philosophical works, and trainer/QA submissions to ensure outputs are conceptually accurate, logically rigorous, nuanced, and aligned with project standards.

Your work will directly contribute to improving advanced AI systems by ensuring philosophy training data is precise, well-reasoned, ethically aware, and contextually grounded.

Key Responsibilities

Quality Monitoring

• Review philosophy-related tasks and QA outputs
• Identify recurring quality issues
• Provide detailed written feedback
• Escalate critical quality concerns

Philosophy Content Review

• Review and evaluate philosophy explanations, argument analyses, ethical reasoning tasks, logic exercises, conceptual comparisons, philosophical thought experiments, and summaries of philosophers and schools of thought
• Assess work for conceptual accuracy, argument structure, logical validity, philosophical context, interpretation quality, nuance, clarity, instruction adherence, and rubric compliance

Trainer & QA Communication

• Communicate guidelines, workflow changes, quality standards, philosophy review expectations, and evaluation criteria

Contributor Support

• Answer questions involving logic and reasoning, ethical frameworks, philosophical traditions, conceptual distinctions, argument validity, interpretation issues, and rubric application

Activation Management

• Follow up with inactive contributors, track engagement and participation, escalate availability concerns when needed

Documentation & Onboarding

• Create and maintain style guides, documentation, FAQs, quality notes, examples, calibration tasks, and onboarding resources
• Conduct onboarding and training sessions for contributors

Reasoning & Ethics Review

• Identify and flag invalid arguments, logical fallacies, strawman arguments, false equivalences, conceptual confusion, oversimplifications, unsupported claims, misrepresentation of philosophers, ethically shallow analysis, and overconfident conclusions

Process Improvement

• Improve QA workflows and identify recurring quality gaps
• Develop scalable philosophy-review processes

Required Qualifications

• Bachelor's, Master's, PhD, or equivalent background in Philosophy, Ethics, Logic, Political Theory, Religious Studies, Classics, Cognitive Science, or related humanities disciplines
• Strong English communication skills
• Minimum 3 years of experience in philosophy research, teaching, academic writing, editing, ethics review, logic instruction, or humanities-focused review work
• Strong understanding of logic, argument analysis, ethics, epistemology, metaphysics, philosophy of mind, political philosophy, history of philosophy, and conceptual clarification
• Ability to identify invalid reasoning, conceptual errors, unsupported claims, philosophical misinterpretations, oversimplification, weak argumentation, and biased framing

Preferred Qualifications

• Experience with formal logic, moral philosophy, applied ethics, analytic philosophy, continental philosophy, ancient philosophy, political philosophy, philosophy of science, and AI ethics
• Experience with AI training, data annotation, LLM evaluation, academic QA, ethics review, and rubric-based evaluation

Why Join

• Help improve leading AI systems through philosophy-focused quality assurance
• Flexible remote schedule
• Weekly payments
• Access to future opportunities through SME Careers' expert network

Selection Process

1. AI Interview
2. Domain Assessment
3. Recruiter Interview

Important Note

There is currently no active project for this role. Qualified candidates will be added to the SME Careers expert network and contacted when philosophy-related opportunities become available.