Job Description

About the Team

The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.

The evaluation and investigation team, working closely with the search team, taking the evaluation standards as the baseline and principles, and manually evaluating the search query and the corresponding search results page to reflect the real user experience of the search function.

It is possible that this role will be exposed to harmful content as part of the core role/as part of project/ in response to escalation requests/by chance.

This may occur in the form of images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals.

What will I be doing?

- Complete regular assessments related to AI model quality in accordance with evaluation standard documents.

- Use evaluation methods to complete daily strategy assessment of AI model quality in accordance with evaluation standard documents.

- Analyze the types of AI model bad cases and rate the quality of the results.

- While it is assumed the evaluator will focus on their area of expertise, there will be occasions in which will work on projects outside this core area that could require other capabilities, such as using assessment methods flexibly to support related projects.

- Willing to work with sensitive issues that include child exploitation, a variety of religious and political views, violence, adult & sexual content.

- Parts of this role will require supporting other products within the ByteDance suite. ByteDance is TikTok's parent company, whose mission is to inspire creativity and enrich life.