XPENG

LLM基座模型算法实习生

XPENG  •  Onsite  •  5 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

LLM基座模型算法实习生
深圳、上海
实习
互联网 / 电子 / 网游
职位描述
职位描述
1、负责大模型(LLM: Large Language Model)在人形机器人中的算法设计与开发,将LLM应用于人形机器人的对话、环境感知与人机交互任务;
2、深度参与大语言模型从预训练到后训练的全流程工作,并通过数据合成等技术打造高质量的训练数据集;
3、与机器人平台团队、硬件团队紧密协作,实现模型在实际机器人系统中的高效运行;
4、跟踪前沿研究,探索学术边界,在充足的资源支持下开展技术预研与实验,推动新技术在产品中的落地应用。
职位要求
职位要求
1、计算机、人工智能、自动化等相关专业硕士及以上学历;
2、具备扎实的深度学习基础,熟悉Transformer、BERT、ViT、CLIP等主流视觉-语言模型架构;
3、有大语言模型(LLM)的训练/微调/推理优化经验,熟悉其在下游任务中的应用;
4、熟练使用Pytorch深度学习框架,具备良好的工程能力和代码实现能力;
5、良好的团队协作与沟通能力,具备快速学习和解决问题的能力。
加分项:
1、有参与实际LLM预训练或后训练(SFT、DPO/RLHF)的相关项目经验;
2、有使用大语言模型进行数据合成(Data synthesis)的相关经验;
3、对大语言模型的预训练/后训练数据集有一定了解,有处理Trillion级别数据集的相关经验;
4、熟悉开源大模型生态(如Qwen, Llama等),对大模型的模型结构优化(如linear attention,Mixture-of-Expert等)有一定了解。
投递
XPENG

About XPENG

XPeng is a leading Chinese Smart EV company that designs, develops, manufactures, and markets Smart EVs that appeal to the large and growing base of technology-savvy middle-class consumers. Its mission is to drive Smart EV transformation with technology and data, shaping the mobility experience of the future. In order to optimize its customers’ mobility experience, XPeng develops in-house its full-stack advanced driver-assistance system technology and in-car intelligent operating system, as well as core vehicle systems including powertrain and the electrical/electronic architecture. XPeng is headquartered in Guangzhou, China. In 2021, the Company established its European headquarters in Amsterdam, along with other dedicated offices in Copenhagen, Munich, Oslo, and Stockholm.The Company’s Smart EVs are mainly manufactured at its plant in Zhaoqing and Guangzhou,Guangdong province.

For more information, please visit https://heyxpeng.com.

Industry
Automotive & Mobility
Company Size
1,001-5,000 employees
Headquarters
Guangzhou, CN
Year Founded
2014
Social Media