Evaluate AI-generated responses to complex accounting problems, helping improve AI systems' accounting capabilities. Collaborate with leading AI researchers and apply your professional accounting expertise to real-world AI evaluation.
Accounting Expert
Job description
Role Overview
Mercor is partnering with a leading AI research organization to engage experienced Accounting experts to evaluate how effectively AI systems perform real-world accounting work.
Rather than producing accounting deliverables yourself, you will define what high-quality accounting looks like by creating task-specific grading criteria and evaluating AI-generated and human work using rigorous, evidence-based scoring.
This is a fully remote, hourly contract opportunity for experienced accounting professionals.
Key Responsibilities
Design Evaluation Criteria
- Develop precise, task-specific grading rubrics for real-world accounting deliverables, including:
- Account reconciliations
- Month-end close packages
- Financial statements
- Financial disclosures
- Audit workpapers
- Technical accounting memos
Evaluate AI Outputs
- Review AI-generated and human accounting work against established evaluation criteria.
- Provide detailed written justifications supporting every score.
Ensure Consistent Quality
- Apply objective, evidence-based judgment to ensure evaluations are reproducible, consistent, and defensible.
Improve Evaluation Standards
- Incorporate structured feedback from senior reviewers.
- Continuously refine grading approaches and evaluation quality.
Required Qualifications
5+ years of professional accounting experience.
Background in:
- Audit
- Assurance
- Advisory
- Senior Corporate Accounting
- Financial Reporting
Experience at a leading accounting firm or large public company is strongly preferred.
CPA or equivalent professional accounting certification is highly preferred.
Strong expertise in:
- US GAAP
- Month-end close
- Account reconciliations
- Financial statement preparation
- Financial disclosures
- Audit-ready workpapers
- Technical accounting documentation
Exceptional written communication skills with the ability to clearly explain why accounting work meets—or fails to meet—professional standards.
Strong analytical thinking with excellent attention to detail.
Comfortable working in calibration and peer-review environments.
Previous experience with AI evaluation, RLHF, data annotation, or AI training projects is a strong advantage.
Compensation
- $130–$160 per hour
Work Arrangement
- Independent Contractor
- Fully Remote
- Flexible schedule
- Weekly payments via Stripe or Wise
Application Process
- Submit your resume or professional background.
- Qualified applicants may complete a brief technical assessment or provide additional information.
About Mercor
Mercor connects experienced professionals with leading AI laboratories to help train and evaluate frontier AI systems. Contributors work on high-impact AI research projects while enjoying flexible remote work and competitive compensation.
You will be redirected to the company's website to complete your application.