Xiaomi Technology

大模型推理优化工程师

Xiaomi Technology  •  Onsite  •  8 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

大模型推理优化工程师
北京
社招
全职
职位 ID:A234561
职位描述
1、负责大模型的移动端部署与优化工作;
2、面向端侧算力与内存受限场景,探索高效的大模型结构与推理策略,如端侧友好的 MoE 方案、稀疏与线性注意力、长上下文推理优化等,实现模型在性能、效果与资源消耗之间的最优权衡。
3、参与大模型与芯片协同设计(Model–Chip Co-design),不断挖掘移动芯片算力潜能,实现业界领先的大模型执行效能;
4、撰写相关论文,专利。
职位要求
1、信号处理/模式识别/人工智能等相关专业毕业,熟练使用C/C++;
2、对深度学习有深刻认识,熟悉各种神经网络及背后数学原理,熟悉各类神经网络模型的量化/压缩/性能优化方案;
3、对大模型加速优化方案有深入了解,对投机采样,GQA,MOE,Lora量化等技术有开发与优化经验者优先。
4、有vllm,sglang,Genie等云端/移动端大模型推理框架开发经验者优先;
5、有相关领域高质量会议/期刊论文,或深度参与过开源深度学习框架的开发并有相应贡献者优先。
投递
Xiaomi Technology

About Xiaomi Technology

Xiaomi Corporation was founded in April 2010 and listed on the Main Board of the Hong Kong Stock Exchange on July 9, 2018 (1810.HK). Xiaomi is a consumer electronics and smart manufacturing company with smartphones and smart hardware connected by an IoT platform at its core.

Embracing our vision of “Make friends with users and be the coolest company in the users’ hearts”, Xiaomi continuously pursues innovations, high-quality user experience and operational efficiency. The company relentlessly builds amazing products with honest prices to let everyone in the world enjoy a better life through innovative technology.

Xiaomi is one of the world's leading smartphone companies. The company has also established the world’s leading consumer AIoT (AI+IoT) platform,reached 558 million smart devices connected to its platform (excluding smartphones,laptops and tablets) as of September 30 2022. Xiaomi products are present in more than 100 countries and regions around the world. In August 2022, Xiaomi was included in the Fortune Global 500 list for the fourth year in a row, ranking 266th. The company is the fastest-rising Chinese technology conglomerate during the four-year period.

Xiaomi is a constituent of the Hang Seng Index, Hang Seng China Enterprises Index, Hang Seng TECH Index and Hang Seng China 50 Index.

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Beijing, CN
Year Founded
2010
Social Media