Seeking experienced Data Scientists to design evaluation rubrics, assess AI-generated data science work, and improve frontier AI systems through rigorous, evidence-based evaluation.
R Engineer
Job description
As a remote R Engineer, you will review AI-generated responses and create high-quality R programming and data analysis content used to train and evaluate advanced AI systems.
This role focuses on evaluating:
- Statistical reasoning
- Data analysis workflows
- R programming quality
- AI-generated analytical solutions
- Step-by-step problem solving
Contributors will assess AI responses for:
- Accuracy
- Clarity
- Statistical correctness
- Prompt adherence
- Reasoning quality
This is a contract opportunity with SME Careers, an AI Data Services company and subsidiary of SuperAnnotate supporting leading AI labs and foundation model companies.
Important Note
There is currently no immediate active project for this role.
Qualified applicants will join the expert network and may be contacted first for future R-related projects and AI evaluation opportunities.
Key Responsibilities
Develop AI Training Content
- Create detailed prompts and solutions involving:
- R programming
- Statistical analysis
- Data science workflows
- Machine learning tasks
Evaluate AI Responses
- Review AI-generated answers for:
- Correctness
- Statistical validity
- Code quality
- Logical reasoning
- Analytical clarity
Optimize AI Performance
- Rank and compare multiple AI responses
- Improve:
- Accuracy
- Fluency
- Contextual relevance
- Technical reliability
Ensure Model Integrity
Identify:
- Statistical errors
- Biases
- Incorrect methodologies
- Faulty data wrangling workflows
Validate model reliability across analytical use cases
Required Qualifications
Minimum 2 years of hands-on experience using R
Strong R programming skills including:
- Data wrangling
- Functional programming
- Reusable functions
- Package development
Strong applied statistics background including:
- Regression
- Inference
- Model validation
Experience building end-to-end analyses involving:
- Data cleaning
- Exploratory analysis
- Modeling
- Visualization
Familiarity with:
- tidyverse
- data.table
- ggplot2
Professional experience in:
- Data science
- Statistics
- Quantitative analysis
- Similar analytical roles
Bachelor’s degree in:
- Statistics
- Mathematics
- Computer Science
- Related quantitative field
Significant experience using LLMs for:
- Coding assistance
- Analysis design
- Code review
Strong English writing and explanation skills
C1 English proficiency required
Preferred Qualifications
- Experience with:
- AI training
- Model evaluation
- AI data annotation
- AI reasoning evaluation
Why Work with SME Careers
Shape the Future of AI
Contribute directly to improving world-class AI systems and models.
Flexible Work
Set your own schedule and work remotely.
Weekly Payments
Receive reliable weekly payments for approved work.
Community Rewards
Referral bonus opportunities available.
About SME Careers
SME Careers is an AI Data Services company and subsidiary of SuperAnnotate that provides training data and evaluation expertise for leading AI companies and foundation model labs worldwide.
You will be redirected to the company's website to complete your application.