CIS Controls v8 Assessor Responsibilities: • Assess client organizations against the Center for Internet Security Critical Security Controls Version 8 framework.
Risk Management Expert
Job description
In this remote contractor role, you will work as a Risk Management Subject Matter Expert (SME) reviewing AI-generated risk management responses and creating expert risk management content.
The work focuses on evaluating reasoning quality, risk assessment methodologies, governance practices, controls design, mitigation planning, and compliance awareness while providing detailed written feedback that improves AI model performance.
Important Note
There is currently no active project attached to this role.
Qualified candidates will join the expert network and may be among the first professionals contacted when relevant opportunities become available.
What You'll Do
Review AI Responses
Evaluate AI-generated risk management answers
Assess:
- Accuracy
- Clarity
- Completeness
- Practical usefulness
- Prompt adherence
Identify:
- Risk identification errors
- Assessment methodology flaws
- Control design weaknesses
- Governance issues
- Mitigation planning gaps
- Incident response mistakes
- Compliance-related inaccuracies
Create Expert Content
- Develop detailed prompts and gold-standard solutions
- Create content covering:
- Risk assessments
- Control mappings
- Mitigation plans
- Governance processes
- Risk communication scenarios
Improve AI Performance
- Compare and rank multiple AI responses
- Improve:
- Correctness
- Rigor
- Clarity
- Decision-making quality
Ensure Model Integrity
- Test outputs for:
- Inaccuracies
- Unsafe recommendations
- Misleading certainty
- Bias
- Reliability issues
Required Qualifications
Bachelor's degree or higher in:
- Business
- Finance
- Economics
- Risk Management
- Law
- Information Technology
- Related fields
Equivalent professional experience may also qualify
Professional Experience
- 5+ years of experience in:
- Enterprise Risk Management (ERM)
- Operational Risk
- Compliance
- Internal Audit
- Security Risk
- Third-Party Risk Management
- Similar risk-focused functions
Risk Management Expertise
Strong understanding of:
- Risk taxonomy
- Inherent risk vs residual risk
- Likelihood and impact scoring
- Control design
- Control effectiveness
- KRIs
- KPIs
Framework Knowledge
Familiarity with:
- COSO ERM
- ISO 31000
- NIST
- SOC 2 concepts
- ISO 27001 concepts
- SOX controls
Governance Experience
Experience with:
- Risk registers
- Policy development
- Risk committees
- Escalation processes
- Executive reporting
- Governance frameworks
Additional Requirements
Ability to evaluate:
- Scope assumptions
- Risk appetite alignment
- Control gaps
- Remediation feasibility
- Implementation timelines
Strong written communication skills
Ability to create decision-ready summaries
Minimum C1 English proficiency
Self-directed and reliable work habits
Preferred Qualifications
Professional certifications such as:
- CRISC
- CISA
- CIA
- ISO 27001 LI/LA
- PMP
- FRM
Preferred experience in:
- AI training or annotation
- Policy review
- Audit QA
- Risk QA
- Regulatory writing
Key Responsibilities
Develop AI Training Content
Create:
- Risk assessment scenarios
- Control mapping exercises
- Mitigation planning content
- Governance and compliance prompts
- Risk communication examples
Optimize AI Performance
- Evaluate and rank AI outputs
- Improve reasoning quality
- Improve practical usefulness
- Improve compliance awareness
Ensure Model Integrity
- Validate reliability across business and risk scenarios
- Identify unsafe or inaccurate recommendations
Why Work with SME Careers?
Shape the Future of AI
Your expertise helps improve how advanced AI systems reason about risk management, governance, controls, and compliance.
Flexible Schedule
Work remotely and set your own hours.
Weekly Payments
Receive payments once approved work is completed.
Referral Rewards
Earn additional income through referral programs.
About SME Careers
SME Careers is an AI Data Services company and subsidiary of SuperAnnotate.
The company provides expert-generated training data to many of the world's leading AI companies and foundation model developers.
You will be redirected to the company's website to complete your application.