Xiaomi Technology

顶尖应届-具身大模型训练推理算法工程师-机器人事业部

Xiaomi Technology  •  Onsite  •  1 hour ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

顶尖应届-具身大模型训练推理算法工程师-机器人事业部

北京

校招

正式

算法类

职位描述

1、基于 PyTorch 生态(FSDP / DeepSpeed / Megatron 等)设计并实现具身大模型分布式训练方案(DP / TP / PP / MoE); 2、推动混合精度(BF16 / FP8)与算子融合(FlashAttention / Triton kernel)等性能优化,构建高吞吐数据 pipeline 与 shard 策略; 3、负责模型推理加速与部署优化,设计 Causal-DiT / MoE-DiT / AR-Diffusion 等混合架构提升吞吐与生成质量; 4、构建模型数据的自蒸馏 / 自进化框架,让模型能高效输出数据并持续优化; 5、支持大规模实验追踪、管理、指标可视化,与算法团队协同完成模型高效迭代。

职位要求

1、扎实的 Python / C++ 基础,熟悉 Linux; 2、深入理解 PyTorch 分布式训练,熟悉至少一种分布式训练优化框架(FSDP / DeepSpeed / Megatron-LM); 3、深入理解 GPU / CPU / 内存 / 网络 基本原理;理解 Transformer / Diffusion / MoE 等主流结构的性能瓶颈与优化方法。 加分项 1、多模态 / VLA / 世界模型 / 视频生成 大规模训练经验; 2、熟悉 NCCL / RDMA / InfiniBand 调优;有自定义 CUDA / Triton kernel 经验; 3、熟悉 TensorRT / ONNX Runtime / Triton 等推理框架,具备量化、算子融合、显存优化实践经验; 4、在 NeurIPS / ICLR / ICML / CVPR / ICCV / ECCV / RSS / CoRL / ICRA 等顶会有相关成果。

职位信息

课题名称及内容:

【课题名称】 具身大模型训练与推理 Infra 搭建 【课题内容】 面向VLA / 具身推理 / 世界模型等大模型的大规模训练与推理基础设施,覆盖分布式训练框架、混合精度与算子优化、推理加速与部署、自蒸馏 / 自进化 pipeline 等核心模块,目标是构建稳定、高吞吐、低延迟的训练推理框架,支撑百亿 / 千亿参数量级模型的高效迭代与真机落地。

投递

Xiaomi Technology

About Xiaomi Technology

Xiaomi Corporation was founded in April 2010 and listed on the Main Board of the Hong Kong Stock Exchange on July 9, 2018 (1810.HK). Xiaomi is a consumer electronics and smart manufacturing company with smartphones and smart hardware connected by an IoT platform at its core.

Embracing our vision of “Make friends with users and be the coolest company in the users’ hearts”, Xiaomi continuously pursues innovations, high-quality user experience and operational efficiency. The company relentlessly builds amazing products with honest prices to let everyone in the world enjoy a better life through innovative technology.

Xiaomi is one of the world's leading smartphone companies. The company has also established the world’s leading consumer AIoT (AI+IoT) platform,reached 558 million smart devices connected to its platform (excluding smartphones,laptops and tablets) as of September 30 2022. Xiaomi products are present in more than 100 countries and regions around the world. In August 2022, Xiaomi was included in the Fortune Global 500 list for the fourth year in a row, ranking 266th. The company is the fastest-rising Chinese technology conglomerate during the four-year period.

Xiaomi is a constituent of the Hang Seng Index, Hang Seng China Enterprises Index, Hang Seng TECH Index and Hang Seng China 50 Index.

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Beijing, CN
Year Founded
2010
Social Media