NIO

大模型后训练实习生

NIO  •  Onsite  •  1 month ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

大模型后训练实习生北京实习数字技术 - 算法职位 ID:A174789职位描述参与面向车载人机智能交互场景的大语言模型结构优化工作,包括模型结构修改、模型轻量化设计等方向的探索与实验。
协助搭建和维护基于Megatron-Core的分布式训练环境,参与TP/PP/DP等并行策略的配置与调优。
参与模型蒸馏相关技术的调研与实验,协助实现知识迁移、泛化能力提升。
协助优化训练流程,包括数据预处理、训练监控、性能 profiling 等基础工作。
协助分析训练过程中的基础问题(如loss波动、显存溢出等),参与解决方案的验证。职位要求本科及以上学历在读,计算机、人工智能、数学等相关专业,具备良好的编程和数学基础。
熟练掌握Python,了解PyTorch等深度学习框架,有实际的模型训练经验。
了解Transformer架构及主流LLM结构(如Llama、Qwen等),熟悉常见的模型组件(Attention、FFN、LayerNorm等)。
了解分布式训练基本概念,有Megatron、DeepSpeed等框架使用经验者优先。
了解模型蒸馏、量化等模型压缩技术的基本原理,有相关课程项目或开源实践者优先。
具备良好的学习能力与团队协作意识,对大规模模型训练有浓厚兴趣,愿意深入钻研技术细节。
每周可实习4天以上,实习期3个月以上,有相关论文或开源项目贡献者优先。 投递
NIO

About NIO

NIO is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November 2014, NIO’s mission is to shape a sustainable and brighter future together. NIO aims to build a community starting with smart electric vehicles to share joy and grow together with users.

NIO designs, develops, jointly manufactures and sells premium smart electric vehicles, driving innovations in next-generation technologies in autonomous driving, digital technologies, electric powertrains and batteries. NIO differentiates itself through its continuous technological breakthroughs and innovations, such as its industry-leading battery swapping technologies, Battery as a Service, or BaaS, as well as its proprietary autonomous driving technologies and Autonomous Driving as a Service, or ADaaS.

NIO’s models for sale include the all-new smart electric flagship SUV ES8, the smart electric flagship coupe SUV EC7, the smart electric mid-large SUV ES7, the smart electric flagship sedan ET7, the all-new smart electric all-round SUV ES6, the all-new smart electric coupe SUV EC6, the smart electric mid-sized sedan ET5, and the smart electric tourer ET5T.

Industry
Unknown
Company Size
5,001-10,000 employees
Headquarters
Jiading, CN
Year Founded
Unknown
Website
nio.com
Social Media