TikTok

LLM Evaluation Product Operations Specialist – TikTok

TikTok  •  San Jose, CA (Onsite)  •  5 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

About the Team:

We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product improvement.

Responsibilities

- Own the end-to-end design and implementation of the AI chatbot experience evaluation framework within Tako; support ongoing product iteration and optimization.

- Leverage user research and data analysis to uncover user needs; define the ideal experience quality standard for the product and drive improvements in model capability and user satisfaction.

- Collaborate with strategy and algorithm teams to build a scenario-based evaluation metrics system for Tako; deliver analytical insights and recommendations to improve and retain search users.

- Partner with international delivery teams to drive the execution of evaluation programs; leverage automated evaluation methods to ensure projects are delivered on time and to quality standards.
TikTok

About TikTok

Inspire Creativity and Bring Joy

Industry
Arts & Entertainment
Company Size
10,000+ employees
Headquarters
Los Angeles, California
Year Founded
Unknown
Social Media