Finance Model Prompt Evaluator

About Mercor

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems while collaborating with top researchers and shaping next-generation AI systems.

Role Overview

We are seeking expert finance and economics professionals to author and verify high-quality, open-ended prompts for AI model evaluation.

In this role, you will craft and review challenging financial analysis problems across core subdomains, assess AI reasoning quality, and help establish rigorous evaluation standards for frontier language models.

You will be assigned one of two task types:

Authoring Task

• Create 5 original, open-ended prompts from your assigned subdomain.
• Cover varying difficulty levels (undergraduate, advanced undergraduate, graduate/professional).
• Ensure prompts require human judgment to evaluate AI responses (e.g., quantitative analysis, risk modeling, regulatory reasoning).

Verification Task

• Review 5 authored prompts for clarity, scope alignment, difficulty accuracy, and uniqueness.
• Edit prompts and difficulty ratings where necessary.

Financial Analysis Subdomains Covered

• Quantitative Finance, Derivatives & Trading
• Macroeconomics, Rates, FX & Sovereign Finance
• Banking, Lending & Financial Institutions
• Risk Management, ALM & Insurance
• Wealth Management, Personal Finance, Digital & Alternative Assets
• Real Estate, Infrastructure, Commodities & Tangible Assets
• Regulation, Compliance, Tax & Cross-Border Structuring

Key Responsibilities

• Author clear, unambiguous, open-ended financial prompts.
• Ensure prompts elicit evaluable AI responses with meaningful reasoning depth.
• Verify prompts align with assigned subdomains and correct difficulty levels.
• Ensure all prompts within a task are distinct and varied in complexity.
• Apply expert judgment to assess financial reasoning depth and rigor.
• Edit prompts and difficulty assignments where standards are not met.

Ideal Qualifications

• Master’s degree or higher in Finance, Economics, Financial Engineering, or a related field.
• 2–6 years of professional experience in financial services, investment banking, asset management, or related fields.
• Strong command of financial modeling, quantitative methods, and regulatory frameworks.
• CFA, FRM, CPA, or equivalent certification is a strong plus.
• Excellent written English with the ability to craft precise, well-scoped technical questions.

Work Details

• Commitment: 10+ hours per week
• Work Type: Asynchronous, fully remote

Contract & Payment Terms

• Independent contractor engagement.
• Flexible schedule; work on your own time.
• Weekly payments via Stripe or Wise based on completed work.
• Projects may be extended, shortened, or concluded early depending on performance and business needs.
• No access to confidential or proprietary external data required.

Additional Notes

• We consider all qualified applicants without regard to legally protected characteristics.
• Reasonable accommodations are available upon request.
• Unable to support H1-B or STEM OPT candidates at this time.