Meta

Research Scientist Manager, MetaAI Assistant Measurement

Meta  •  Menlo Park, CA (Onsite)  •  3 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Meta Superintelligence Labs is seeking a Research Scientist Manager to lead a high-impact team working on the next generation of AI Assistants powered by frontier-scale foundation models. This role centers on building cutting-edge measurement and evaluation paradigms that align fast-moving model development with real end-user value. As a Research Scientist Manager, you will define the scientific strategy behind the evaluation flywheel, ensure scientific across methodologies, and partner with product, engineering, and model training teams to steer the system toward reliability and trustworthiness at scale.

Responsibilities
Define and execute the scientific roadmap for measurement of AI Assistant with purpose, agility, and efficiency
* Lead the development of innovative offline and online evaluation metrics, benchmarks, and data synthesis methodologies to drive model improvement and improve user experience
* Partner closely with research, engineering, and product teams to integrate robust measurement into the model development lifecycle (the "evaluation flywheel")
* Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects
* Mentor and grow a team of Industry-Leading research scientists and applied scientists, fostering a of scientific rigor, impact, and success

Qualifications
12+ years of, or PhD + 8 years of hands-on experience in large language model, NLP, and Transformer modeling, in the setting of both research and engineering development
* Experience and track record of landing large research and/or product impacts in a time-sensitive environment
* 2+ years of people-management experience leading research scientists or applied scientists
* Proven technical vision in where the field of generative AI will go
* Experience of and knowledge of online and offline measurement, benchmark building, and data synthesis
* Experience with cross functional collaboration with other teams including non-engineering functions
* Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management PhD or equivalent research experience in fields such as machine learning, statistics, econometrics, causal inference, computer science, optimization, or related areas
* Experience developing evaluation frameworks for LLMs, multimodal models, or interactive assistants
* Expertise in online measurement, user-behavior modeling, A/B testing, and experiment platform design
* Experience building large-scale datasets and ontologies used for training or evaluation
* Background in safety, alignment, content evaluation, or human-AI interaction
* Ability to communicate complex ideas clearly to executives, product partners, and engineering stakeholders
* Proven ability to build high-performing teams that thrive under ambiguity and rapid iteration
* Experience with cross functional collaboration with other teams including non-technical functions
* Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management
Meta

About Meta

Meta's mission is to build the future of human connection and the technology that makes it possible.

Our technologies help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.

To help create a safe and respectful online space, we encourage constructive conversations on this page. Please note the following:

• Start with an open mind. Whether you agree or disagree, engage with empathy.

• Comments violating our Community Standards will be removed or hidden. Please treat everybody with respect.

• Keep it constructive. Use your interactions here to learn about and grow your understanding of others.

• Our moderators are here to uphold these guidelines for the benefit of everyone, every day.

• If you are seeking support for issues related to your Facebook account, please reference our Help Center (https://www.facebook.com/help) or Help Community (https://www.facebook.com/help/community).

For a full listing of our jobs, visit https://www.metacareers.com

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Menlo Park, CA
Year Founded
2004
Website
meta.com
Social Media