Job Description
About the team
The Safety Model Operations [SMO] team is responsible for building, optimizing, and maintaining machine learning models and operational processes that support TikTok's Trust & Safety systems. We ensure that automated safety models perform effectively in identifying harmful content, mitigating risks, and maintaining a safe user environment across regions.
The SMO Delivery Team plays a critical role in the organization. Its primary responsibility is to carry out the full spectrum of quality assurance activities for each project. This includes:
- Conducting detailed reviews and complex RCA's to ensure labeling accuracy and consistency
- Monitoring quality performance and compliance against project-specific KPIs
- Identifying trends, risks, and potential gaps in processes or guidelines
- Providing structured feedback and improvement recommendations to the Central Project Team
- Supporting continual optimization of workflows, tools, and evaluation methodologies
- Improve Model performance of AI models
Key Responsibilities
- Interpret regulations, community standards, and platform policies, converting them into actionable guidelines. Build a case database to ensure consistent judgments across different scenarios.
- Monitor the content ecosystem of user-generated content (UGC) and producer-generated content (PGC), proactively identifying explicit and implicit content risks, as well as borderline content risks, and extracting risk characteristics.
- Handle emergent content safety risk events, quickly defining the issues and prioritizing actions, promoting cross-department collaboration to complete the resolution loop and optimize the review process.
- Produce risk assessment reports to provide decision support for optimizing platform rules and review strategies.
- Proficient in using content review tools, public opinion monitoring systems, and data analysis tools, collaborating with operations, safety product, and other teams to implement risk prevention strategies.