Economics Quality Assurance Lead (QAL)
Job description
Job Summary
As an Economics Quality Assurance Lead (QAL), you will oversee quality, consistency, and contributor performance across economics-focused AI training projects.
This role involves reviewing AI-generated economics content, evaluating trainer and QA outputs, maintaining quality standards, and ensuring training data aligns with project requirements and client expectations.
Your work will directly contribute to improving advanced AI systems by ensuring economics training content is accurate, analytically sound, assumption-aware, well-reasoned, and clearly explained.
Key Responsibilities
Quality Monitoring
- Spot-check economics training tasks and QA outputs
- Identify recurring quality issues and analytical weaknesses
- Provide actionable written feedback and escalate critical concerns
Economics Content Review
- Review and evaluate economics explanations, calculations, graphs and charts, policy analyses, data interpretations, economic reasoning, and quantitative assessments
- Assess work for economic accuracy, model reasoning, assumption quality, data interpretation, calculation correctness, policy nuance, analytical rigor, and instruction adherence
Trainer & QA Communication
- Communicate guidelines, workflow changes, economics review standards, quality expectations, and project requirements
Contributor Support
- Answer questions involving economic models, economic assumptions, formulas, graph interpretation, causal reasoning, policy analysis, data interpretation, and rubric interpretation
Activation Management
- Follow up with inactive contributors, track engagement and participation, report contributor availability concerns
Documentation & Onboarding
- Create and maintain style guides, documentation, FAQs, examples, calibration tasks, and onboarding materials
- Conduct onboarding and training sessions for contributors
Risk & Quality Review
- Identify and flag incorrect assumptions, flawed causal reasoning, wrong formulas, misleading graphs, unsupported policy claims, weak statistical reasoning, poor data interpretation, oversimplified conclusions, and politically biased analysis
Process Improvement
- Improve QA workflows and review processes
- Identify recurring quality gaps and implement corrective actions
Required Qualifications
- Bachelor's, Master's, or PhD in Economics, Applied Economics, Econometrics, Public Policy, Finance, Statistics, Mathematics, or related quantitative or social science disciplines (or equivalent professional experience)
- Strong English communication skills
- Minimum 3 years of experience in economics research, policy analysis, economic consulting, teaching, data analysis, econometrics, or content review
- Strong understanding of microeconomics, macroeconomics, market structures, supply and demand, elasticity, incentives, externalities, inflation, unemployment, trade, economic growth, monetary policy, fiscal policy, and basic econometric reasoning
- Ability to identify incorrect assumptions, weak causal claims, invalid calculations, misleading interpretations, unsupported policy recommendations, statistical weaknesses, and analytical flaws
Preferred Qualifications
- Experience with econometrics, regression analysis, causal inference, economic modeling, and public policy evaluation
- Familiarity with Excel, R, Python, Stata, public datasets, and academic economics writing
- Experience with AI training, data annotation, LLM evaluation, academic QA, and rubric-based review
Why Join
- Help improve leading AI systems through economics quality assurance
- Flexible remote schedule
- Weekly payments
- Referral rewards and community incentives
- Access to future opportunities through SME Careers' expert network
Selection Process
- AI Interview
- Domain-Specific Assessment
- Recruiter Interview
Important Note
There is currently no active project for this role. Qualified candidates will be added to the expert network and contacted when relevant opportunities become available.
You will be redirected to the company's website to complete your application.