Seeking experienced Data Scientists to design evaluation rubrics, assess AI-generated data science work, and improve frontier AI systems through rigorous, evidence-based evaluation.
Data Science & Quantitative Analysis Expert
United States
$60 – $90/hr
July 25, 2026
Job description
Role Overview
Cincinnatus LLC is seeking experienced Data Science & Quantitative Analysis Experts to help develop next-generation evaluation benchmarks for frontier AI models. In this fully remote W-2 role, you will design realistic data analysis challenges, build reproducible reference analyses, and evaluate how advanced AI models perform on complex quantitative reasoning and analytical tasks.
Working alongside researchers at a leading AI lab, you will transform real-world analytical workflows into rigorous evaluation benchmarks that test the statistical reasoning, data interpretation, and decision-making capabilities of frontier AI systems.
Key Responsibilities
Design Data Analysis Tasks
- Create realistic, multi-step data analysis challenges based on real-world research and analytics workflows.
- Design tasks involving data cleaning, statistical analysis, method comparison, interpretation, and reporting.
- Develop evaluation benchmarks that test the limits of frontier AI models.
Build Reference Analyses
- Complete your own tasks using Jupyter Notebooks or Google Colab.
- Produce reproducible Python-based analyses with clear documentation.
- Generate reference solutions supported by statistical evidence and sound analytical reasoning.
Evaluate AI Performance
- Assess how AI models perform on quantitative analysis tasks.
- Verify the correctness of statistical calculations, interpretations, and recommendations.
- Identify analytical errors, flawed reasoning, and unsupported conclusions.
Collaborate with Research Teams
- Review tasks created by fellow experts to ensure quality and consistency.
- Work closely with researchers to refine evaluation benchmarks.
- Contribute to improving AI evaluation methodologies for data science and analytics.
Required Qualifications
- Master's degree or PhD in:
- Data Science
- Statistics
- Another quantitative STEM discipline
- Or equivalent practical experience in a research-intensive analytical domain
- At least 1 year of experience in:
- Data Science
- Quantitative Analysis
- Research Engineering
- Research-focused analytical roles
- Strong hands-on experience with:
- Data cleaning
- Statistical analysis
- Correlation analysis
- Hypothesis testing
- Data interpretation
- Proficiency with:
- Jupyter Notebooks
- Google Colab
- Python
- pandas
- NumPy
- Git
- Strong written communication skills for presenting analytical findings.
- High attention to detail and ability to work independently.
- Available to work approximately 35 hours per week.
Preferred Qualifications
- Experience with:
- AI model evaluation
- AI training
- Benchmark development
- Task authoring
- Strong ability to communicate analytical findings to technical and business stakeholders.
Compensation
- $60–$90 per hour
- Full-time W-2 employment
Work Arrangement
- Fully Remote (United States)
- W-2 Contingent Role
- Approximately 35 hours per week
- Opportunity to work with a leading AI laboratory through Cincinnatus LLC
Apply now
You will be redirected to the company's website to complete your application.
About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. This role focuses on evaluating and improving frontier AI coding models through realistic data engineering workflows and structured technical assessments. Contributors…
Job Summary As a Python (ML-Focused) Quality Assurance Lead (QAL), you will oversee quality, consistency, and contributor performance across Python machine learning AI training projects. This role involves reviewing AI-generated Python code, machine learning workflows, model…
Job Summary As a Data Scientist Quality Assurance Lead (QAL), you will oversee quality, consistency, and contributor performance across data science and machine learning AI training projects. This role involves reviewing AI-generated data science content, evaluating trainer and…