Job Description

The Product Data Operations team plays a critical role in product development at Meta. The team provides data and insights that power machine learning and AI at the core of all Meta products. The team partners closely with product and provides the human operational rigor required to develop some of the most advanced technology at Meta. As a Program Manager on the PDO team, you are responsible for managing data labeling and annotation programs end-to-end. You will also be responsible for driving data labeling automation via LLMs, and implementing a human-driven eval process to monitor LLM quality. Additionally, you are responsible for proactively surfacing insights and providing recommendations for product improvement, and actively engaging with colleagues and partners to enhance operational processes across the organization. You will be required to showcase demonstrated leadership, project management, problem solving, and communication skills to both internal and external colleagues at scale.

Responsibilities
Manage multiple data labeling and LLM eval projects end-to-end
* Own project success metrics and timelines, including management of data quality
* Directly manage the workflows and metrics of vendor and contractor teams responsible for data labeling and LLM evaluation
* Work cross-functionally to build datasets that support Product and Engineering, while collecting and analyzing results
* Help establish team goals and work with multiple stakeholders on strategies for executing, measuring progress, and reporting results
* Engage in strategic discussions to identify problems while measuring and improving the quality of workflows
* Identify opportunities to improve tooling and implement scalable solutions

Qualifications
Currently has, or is in the process of obtaining a Bachelor's degree in a directly related field, or equivalent practical experience. Degree must be completed prior to joining Meta
* 3+ years of industry experience in a consumer-oriented product environment, consulting, or operations role
* Experience working independently and a track record of taking initiative
* Communication, presentation, and project management reporting experience
* Experience analyzing and solving problems
* Experience with Excel or Google Sheets Understanding of Facebook and Instagram products
* Experience working with data sets
* Experience with LLMs and evaluation techniques
* Experience with SQL
* Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
* Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
* Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies