Board Game Reasoning Expert (AI Training & Evaluation)

Job Summary

Turing is seeking Board Game Reasoning Experts to help train and evaluate next-generation AI systems.

In this role, you will leverage expertise in board games, strategy, game mechanics, probabilistic reasoning, and complex rule systems to improve the reasoning and decision-making capabilities of large language models (LLMs).

You will contribute to the creation, review, and evaluation of datasets focused on game logic, strategic planning, rule interpretation, and scenario analysis.

Key Responsibilities

• Create and review board game reasoning tasks used to evaluate AI systems
• Analyze board game scenarios, strategic decision trees, rule-based systems, and game mechanics
• Evaluate AI-generated responses for correctness, consistency, and logical reasoning quality
• Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused projects
• Identify logical errors, rule violations, flawed reasoning, and inconsistent conclusions in AI outputs
• Contribute to benchmark datasets, quality assurance workflows, and AI evaluation projects
• Collaborate with project teams to improve evaluation methodologies and dataset quality

Required Qualifications

• Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or related analytical disciplines
• Minimum 2 years of experience in board game design, playtesting, tabletop gaming communities, or strategy-focused gaming environments
• Strong understanding of game mechanics, strategic reasoning, probability, logic, and complex rule systems
• Background in game theory, behavioral economics, decision science, or formal logic
• Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, and strategy games
• Strong analytical and problem-solving skills
• Excellent written communication skills

Preferred Qualifications

• Experience with AI training, data annotation, prompt engineering, quality assurance, game design, or puzzle design
• Experience creating evaluation rubrics, benchmark datasets, or QA frameworks
• Familiarity with Python, SQL, or data analysis tools
• Experience in RLHF, LLM evaluation, synthetic data generation, or AI benchmarking
• Ability to quickly learn new game systems and rule frameworks

About Turing

Turing is one of the world's fastest-growing AI companies, helping leading AI labs improve reasoning, problem-solving, and decision-making capabilities in advanced AI systems.

Engagement Details

• Fully remote contractor engagement
• Expected duration: 2 months
• Minimum 20 hours per week, at least 4 hours per day
• Requires 4 hours of overlap with Pacific Time (PST)
• Selection process includes a take-home assessment