Evaluate AI-generated responses, identify reasoning flaws and nuances, and provide structured written feedback to help improve frontier AI systems.
Fleet Fellow, Generalist Expert
Job description
About Fleet AI
Fleet AI is an applied artificial intelligence company focused on human–AI collaboration at scale.
Our goal is to accelerate the transition to the allocation economy—a future where humans direct work rather than perform it. This capability has historically been limited to the top ~1% of the global economy. We believe it should be accessible to everyone.
To get there, we are building training gyms for AI agents: high-fidelity simulation environments where agents can practice real tasks and humans can supervise, evaluate, and steer their behavior.
About the Role
As a Fleet Fellow, Generalist Expert, you'll contribute broad, adaptable expertise across a range of Fleet AI projects. Unlike domain-specific Expert roles, this position is for versatile generalists who can jump between different types of work—writing, research, evaluation, data annotation, AI training, and more—depending on what's needed.
This role is ideal for sharp, creative generalists who learn fast, write well, follow instructions precisely, and thrive in a dynamic environment where priorities shift and new challenges appear regularly.
What You'll Do
- Complete a wide variety of tasks across Fleet AI projects—writing, evaluation, research, annotation, and more
- Follow detailed instructions carefully and produce high-quality, consistent outputs
- Review and evaluate AI-generated content for accuracy, quality, and usefulness
- Write clearly and creatively across different formats and topics
- Adapt quickly as instructions change and new projects spin up
- Take feedback constructively and apply it immediately to improve your work
- Communicate proactively with the team via Slack—ask questions, flag issues, share updates
- Engage through internal tooling, with contributions tracked to support transparency, feedback, and long-term reputation building
You May Be a Good Fit If You
- Are a strong, creative writer who can adapt tone and style to different contexts
- Have high-quality previous experience with AI training, RLHF, data labeling, or evaluation work (strong preference)
- Can follow detailed, sometimes complex instructions precisely and consistently
- Learn quickly and stay effective when instructions or project scope change
- Are highly communicative—you default to over-communicating on Slack rather than going quiet
- Are a native English speaker located in an English-speaking country (required)
- Can commit to at least 20 hours per week (strong preference)
- Prefer flexible, contract-based engagements over traditional full-time roles
- Care deeply about craft, rigor, and thoughtful execution
How Engagements Work
- Initial assessment via quiz and 3 submitted tasks
- Fully remote, contract-based work
- Projects vary in scope, duration, and time commitment
- Performance, collaboration quality, and activity are transparently tracked
- Fleet is unable to sponsor work authorization in the United States or elsewhere
Compensation
- Base rate: $50/hr
- Occasional bonuses based on performance and project impact
- $200 referral bonus for successful referrals
Our Philosophy
We believe the most important advances in AI will come from close, thoughtful collaboration between humans and machines. That work requires strong judgment, clear communication, and a willingness to operate at the edge of what exists today.
We encourage you to apply even if you don't meet every qualification listed. We care far more about demonstrated ability and how you think than about credentials alone.
You will be redirected to the company's website to complete your application.