Job Description

About the Team

The AI Data Service and Operations (ADSO) team provides both safety and non-safety data annotation services, as well as search operations support, for the company’s international products. Within ADSO, the Account Governance function focuses on ensuring high-quality data and enforcement standards related to account-level risks, including third-party content reposting and related governance scenarios.

Role Overview

In this role, you will support account governance initiatives by ensuring the accuracy, consistency, and reliability of annotated datasets used across policy enforcement and model evaluation. You will work closely with cross-functional stakeholders to uphold quality standards, improve workflows, and support scalable governance solutions across international markets.

Key Responsibilities

- Develop, refine, and maintain Operational Guidelines for assigned policy areas, translating policy intent into clear, actionable instructions and ensuring alignment with policy changes, platform updates, and operational best practices.

- Produce, validate, and maintain high-quality Testing Sets for calibration, labeler's evaluation, arbitration, and operational assessments, ensuring balanced coverage of scenarios, content types, and edge cases.

- Analyze complex, ambiguous, and high-risk cases to provide structured clarifications, reduce enforcement discrepancies, and make guideline and Testing Set improvements.

- Support arbitration, training, and calibration workflows by identifying misapplication patterns and operational gaps, driving measurable improvements in reviewer accuracy and consistency.

- Independently conducted analysis based on RCA findings and successfully addressed errors by updating guidelines, SOPs, and training materials.

- Track quality and operational metrics to identify improvement opportunities and drive continuous enhancements in enforcement accuracy, workflow efficiency, and cross-team effectiveness.

- Contribute to ad-hoc quality and governance initiatives that enhance enforcement quality, operational effectiveness, and team performance.