Xiaomi Technology

大模型算法实习生

Xiaomi Technology  •  Onsite  •  4 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

大模型算法实习生

深圳

校招

实习

算法类

职位描述

  1. 参与端侧大模型架构设计、预训练、后训练、端侧部署和推理加速;目标为通过算法与硬件和芯片的协同设计,在较低的功耗和内存预算下,实现模型效果和推理效率的平衡。 2. 参与LLM在端侧场景下的继续预训练(CPT)、后训练(SFT, OPD, RL等)及量化感知训练(QAT),构建从数据清洗处理到模型部署落地的全链路pipeline。 3. 针对端侧芯片和内存特性,设计新型模型结构,探索参数共享与稀疏化方案。4. 参与模型压缩算法开发,如剪枝、量化、蒸馏等常用技术方案实现。实施低比特量化(如INT4/INT8),在保证精度的前提下压缩模型体积与显存占用。 5. 参与推理加速算法实现,如投机解码、MTP等。6. 前沿技术探索与成果产出,建立端侧大模型相关的创新壁垒,推动顶级会议论文与核心专利产出。

职位要求

  1. 硕士及以上学历在读,人工智能、计算机科学、电子信息技术等相关专业,有python开发经验; 2. 深入掌握Transformer架构,熟悉各种神经网络结构及背后数学原理; 3. 具备以下至少一到两个方向的研究或实践经验:大语言模型、多模态大模型、大模型后训练、大模型预训练、强化学习; 4. 对端侧大模型有设计应用经验者优先;5. 在AI或NLP相关顶级会议,如 ICML / NeurIPS / ICLR / AAAI / ACL / CVPR / EMNLP 等发表论文者优先;

投递

Xiaomi Technology

About Xiaomi Technology

Xiaomi Corporation was founded in April 2010 and listed on the Main Board of the Hong Kong Stock Exchange on July 9, 2018 (1810.HK). Xiaomi is a consumer electronics and smart manufacturing company with smartphones and smart hardware connected by an IoT platform at its core.

Embracing our vision of “Make friends with users and be the coolest company in the users’ hearts”, Xiaomi continuously pursues innovations, high-quality user experience and operational efficiency. The company relentlessly builds amazing products with honest prices to let everyone in the world enjoy a better life through innovative technology.

Xiaomi is one of the world's leading smartphone companies. The company has also established the world’s leading consumer AIoT (AI+IoT) platform,reached 558 million smart devices connected to its platform (excluding smartphones,laptops and tablets) as of September 30 2022. Xiaomi products are present in more than 100 countries and regions around the world. In August 2022, Xiaomi was included in the Fortune Global 500 list for the fourth year in a row, ranking 266th. The company is the fastest-rising Chinese technology conglomerate during the four-year period.

Xiaomi is a constituent of the Hang Seng Index, Hang Seng China Enterprises Index, Hang Seng TECH Index and Hang Seng China 50 Index.

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Beijing, CN
Year Founded
2010
Website
mi.com
Social Media