Job Description

Summary

The Video Computer Vision (VCV) organization is an applied research and engineering team developing next-generation multimodal intelligence technologies across Apple products. Within VCV, our team builds intelligent systems that combine multimodal understanding, reasoning, and tool use to deliver compelling user experiences. Our work is deeply integrated into the Apple ecosystem, partnering across hardware, software, and ML teams to deliver real-time, scalable, and privacy-preserving experiences reaching millions of users.

Description

In this role, you will develop post-training methods that turn foundation models into capable, reliable, and efficient agents for on-device execution. You will develop supervised fine-tuning and reinforcement learning methods for agentic models, alongside the training data, interactive environments, reward signals, and evaluations needed to advance reasoning, tool use, and long-horizon tasks. A central research challenge is enabling smaller models to make effective decisions and complete multi-step tasks within tight latency, memory, and energy budgets. You will investigate how to improve reasoning, planning, and tool use while reducing reliance on lengthy generated reasoning and large inference budgets. Research directions may include structured reasoning, adaptive computation, and training objectives that balance task success with computational cost. You will own the projects end to end: identify capability gaps, formulate hypotheses, build training pipelines, conduct rigorous experiments, and translate frontier research into Apple products that deliver meaningful value to users.

Preferred Qualifications

PhD in Computer Science, Machine Learning, Artificial Intelligence, Computer Vision, Natural Language Processing, or a related field, or equivalent practical experience. Research focus on foundation models, reinforcement learning, agentic systems, multimodal reasoning, or efficient machine learning.

Significant contributions to high-impact technical reports or open-source model releases in agentic post-training, with substantial ownership of research methodology, model training, experimental validation, and technical communication.

Experience developing or training agents for tool use and long-horizon tasks.

Experience designing interactive training environments, trajectory-generation pipelines, reward models, or scalable agent evaluations.

Experience improving smaller models through compute-aware post-training, with an understanding of on-device latency, memory, and energy constraints.

Ability to independently drive research projects and collaborate effectively across research and engineering teams.

Minimum Qualifications

MS in Computer Science, Machine Learning, Artificial Intelligence, Computer Vision, Natural Language Processing, or a related field, or equivalent practical experience.

A strong research track record demonstrated by either first-author publications at top-tier conferences (such as NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, ACL, or EMNLP) or substantial hands-on experience training frontier models, with contributions relevant to foundation models, reinforcement learning, multimodal learning, or agentic systems.

Strong programming skills in Python and proficiency with deep learning frameworks such as PyTorch.

Demonstrated ability to formulate research hypotheses, implement training and evaluation pipelines, conduct controlled experiments, and draw well-supported conclusions.