AI Evaluation & Annotation Specialist (Italian)

Role Overview

We are seeking detail-oriented AI Evaluation & Annotation Specialists to help train and improve Large Language Models (LLMs).

In this role, you will review AI-generated responses, evaluate output quality, annotate content, and follow structured guidelines to improve model performance and consistency.

No engineering background is required. This is an excellent entry point into AI data work, annotation, quality assurance, and language technology.

Key Responsibilities

• Review AI-generated responses for:
  • Clarity
  • Correctness
  • Relevance
• Annotate and label content using project-specific guidelines
• Apply structured instructions consistently across tasks
• Generate or evaluate prompts depending on assignment type
• Collaborate with QA Leads to improve task quality
• Report completed work daily while meeting productivity standards
• Maintain high accuracy and consistency in annotation workflows

Required Skills & Qualifications

• Fluency in Italian with strong written and verbal communication skills
• Strong reading comprehension and critical thinking abilities
• High attention to detail and accuracy
• Ability to work independently with minimal supervision
• Comfortable following structured instructions and workflows
• Bachelor's degree in:
  • Linguistics
  • Computer Science
  • Related field
  • Or equivalent practical experience
• Willingness to learn AI and annotation tools

Preferred Qualifications

• Experience or interest in:
  • AI
  • Machine Learning
  • Data annotation
  • Translation
  • Localization
  • QA workflows
• Familiarity with annotation or AI evaluation tools
• Experience working with structured datasets and labeling systems

Schedule & Work Expectations

• Standard expectation:
  • One consecutive 8-hour shift
  • OR two 4-hour shifts within approved windows
• Shift window aligned to PST schedules
• Only approved logged hours are paid
• No paid holidays or paid time off included

Work Details

• Fully remote contractor role
• Collaborative global AI team environment
• Strong opportunity for career growth within AI evaluation and annotation workflows

Assessment Requirement

All applicants are required to complete an unpaid skills-based assessment as part of the application process. Completion does not guarantee selection but is mandatory for consideration.

Location Restrictions

Applicants residing in the following countries are not eligible:

• Argentina
• Bolivia
• Brazil
• Canada
• Chile
• China
• Colombia
• Cuba
• Ecuador
• Iran
• Iraq
• North Korea
• Mexico
• Panama
• Russia
• Sudan
• Syria
• United Kingdom
• Venezuela
• Certain restricted regions of Ukraine

Why Join

• Work with a global AI-focused team
• Gain experience in real-world AI model training
• Build skills in:
  • Annotation
  • AI evaluation
  • QA workflows
  • Structured reasoning tasks
• Strong entry point into the AI and language technology industry