Job Description

Good AI is built on good judgment.

TrustScale is looking for experienced Italian-language professionals who can distinguish between an acceptable response and an exceptional one.

As an AI Quality Reviewer, you will evaluate AI-generated content, identify quality issues, and help establish the standards that AI systems learn from. This is more than checking boxes or following a script. We are looking for people who can think critically, spot nuances, and make consistent quality decisions.

We are seeking experienced reviewers to support upcoming AI quality initiatives. Applications are reviewed on a rolling basis.

Remote | Freelance | Flexible Hours | Paid in USD

What You'll Do

• Review AI-generated responses in Italian
• Evaluate quality, factual accuracy, relevance, and consistency
• Identify errors, gaps, and guideline deviations
• Assess annotation outputs and reviewer decisions
• Provide clear quality feedback and rationale
• Participate in training and calibration sessions
• Maintain high quality while meeting project expectations

We're Looking For

• Native or near-native Italian proficiency
• Strong English reading comprehension
• Experience in quality assurance, fact-checking, content review, annotation, search evaluation, research, editorial work, or similar analytical roles
• Excellent attention to detail
• Strong critical-thinking and decision-making skills
• Ability to work independently and apply guidelines consistently

Bonus Points

• Experience with AI, LLMs, or response evaluation
• Search quality or data annotation review experience
• Background in journalism, linguistics, translation, education, or research

Why TrustScale

• Flexible remote work
• Paid in USD
• Long-term project opportunities
• Exposure to advanced AI evaluation methodologies
• Opportunity to progress into senior AI Quality and QC Specialist roles

At TrustScale, quality is not measured by how much work is completed. It is measured by how well human expertise helps AI make better decisions.