Remote contract opportunity for experienced mechanical engineers to evaluate AI-generated engineering solutions and contribute expertise toward advanced AI systems.
Simulated Research Reviewer (MechE & Mat-Sci)
Job description
Mercor is seeking Mechanical Engineering and Materials Science experts to review simulated research environments developed for a leading AI lab.
Contributors will evaluate scientific research scenarios built around underlying simulators and datasets. Each environment contains multiple AI agent trajectories, representing different prompts and approaches applied to the same scientific problem.
The role focuses on assessing scientific reasoning, problem quality, experiment design, and research validity to help improve next-generation AI research agents.
What You'll Do
Review AI Research Trajectories
For each environment, review:
- Input datasets and simulation context
- Three or more AI agent trajectories
- Complete model responses and reasoning chains
Trajectory Summarization
Provide structured summaries describing:
- What each AI agent did
- How conclusions were reached
- Scientific reasoning used throughout the process
Problem Quality Assessment
Evaluate whether:
- The problem reflects a realistic scientific challenge
- Genuine scientific expertise is required
- The task represents meaningful research work
Construction Quality Review
Assess:
- Context sufficiency
- Experiment usefulness
- Solvability
- Importance of experiment selection
- Saturation and headroom
- Reasonableness of evaluation metrics
Question Diversity Analysis
Evaluate the diversity and uniqueness of prompts within the same environment.
Alternative Framing
Suggest:
- More natural research questions
- More interesting formulations
- Alternative scientific tasks using the same simulator or dataset
Ideal Qualifications
Education
- Master's degree or PhD in:
- Mechanical Engineering
- Materials Science
- Closely related disciplines
Research Experience
- Computational simulation
- Experimental design
- Scientific computing
- Engineering research workflows
Technical Skills
- Strong analytical writing skills
- Ability to provide structured technical feedback
- Deep understanding of core concepts within the candidate's specialty area
Project Details
- Start Date: Immediate
- Duration: Approximately 3 weeks
- Expected Final Delivery: June 26
- Schedule: Flexible
- Engagement Type: Part-time
- Compensation: Hourly
Contract & Payment Terms
- Independent contractor engagement
- Fully remote work
- Flexible schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded based on project needs and performance
Important Note
Mercor currently cannot support:
- H1-B candidates
- STEM OPT candidates
About Mercor
Mercor partners with leading AI labs and enterprises to train and evaluate frontier AI systems using human expertise.
Contributors work directly on projects shaping the future of AI research while collaborating with leading researchers and technical experts.
You will be redirected to the company's website to complete your application.