Job Description

About the team

The AI Data Service and Operations (ADSO) team is responsible for providing safety and non-safety data annotation services and search operation services for all of the company's international products, which can also help international products build their own data ecological security.

Key Responsibilities

- Develop, refine, and maintain Operational Guidelines for assigned policy areas, translating policy intent into clear, actionable instructions and ensuring alignment with policy changes, platform updates, and operational best practices.

- Produce, validate, and maintain high-quality Testing Sets for calibration, QA evaluation, arbitration, and operational assessments, ensuring balanced coverage of scenarios, content types, and edge cases.

- Analyze complex, ambiguous, and high-risk cases to provide structured clarifications, reduce enforcement discrepancies, and inform OG and Testing Set improvements.

- Support arbitration, QA, training, and calibration workflows by identifying misapplication patterns and operational gaps, driving measurable improvements in reviewer accuracy and consistency.

- Collaborate cross-functionally with Policy, Governance, Product, Engineering, Algo, and Training teams to ensure OGs and Testing Sets are scalable, actionable, and effectively translated into SOPs and training materials.

- Track quality and operational metrics to identify improvement opportunities and drive continuous enhancements in enforcement accuracy, workflow efficiency, and cross-team effectiveness.

- Contribute to ad-hoc quality and governance initiatives that enhance enforcement quality, operational effectiveness, and team performance.