Job Description

多模态大模型开发工程师上海全职制造与工艺板块职位描述1、工艺大模型研发：探索利用LLM大模型+知识库+LoRA微调技术路线，实现工艺开发AI流程自动化。
2、工业视觉大模型的研发：解决小样本缺陷、域迁移、零样本异常检测等难题，构建可泛化到多车型、多产线的视觉大模型底座。
3、模型工程化与验证
与广州团队协作，将训练的模型部署到实际产线和项目中并持续迭代。确保大模型能从广州团队的反馈中持续学习，探索利用大模型生成合成数据，解决工业场景数据问题
4、持续跟踪AI领域最新模型、论文、开源项目及行业应用案例，定期输出AI技术动态与工业应用评估。对筛选出的前沿模型（如新的视觉基础模型、Agent框架、数据处理技术）进行快速复现和微调职位要求1、硕士及以上，计算机科学、人工智能、模式识别等相关专业
2、3年以上大模型（LLM或多模态）研发经验，有工业大模型项目经历者优先
3、精通PyTorch/TensorFlow，熟悉Transformer、Diffusion、CLIP等架构；
4、熟悉主流通用大模型（如GPT系列、LLaMA、Qwen等）的架构与微调方法，精通LoRA、QLoRA、P-Tuning等参数高效微调技术
5、了解工业视觉常用检测算法（如YOLO系列、ViT、DETR）和异常检测方法
6、具备出色的文献阅读与复现能力，能快速理解arXiv、会议（CVPR、ICML、NeurIPS、ICLR、ACL等）及开源社区（Hugging Face、GitHub Trending等）的最新工作
加分项：
1、有制造工艺背景或工业数据分析经验，熟悉工业场景的数据特性（如时间序列、多模态对齐等）
2、在AI顶会（CVPR、ICCV、NeurIPS、ICML、ACL等）发表过论文
3、有Agent（智能体）相关研究或应用经验（如ReAct、AutoGPT、Plan-and-Solve）
4、有多模态融合（如LLaVA、Flamingo、BLIP-2）实际经验，能将视觉特征注入LLM实现联合推理投递

About XPENG

XPeng is a leading Chinese Smart EV company that designs, develops, manufactures, and markets Smart EVs that appeal to the large and growing base of technology-savvy middle-class consumers. Its mission is to drive Smart EV transformation with technology and data, shaping the mobility experience of the future. In order to optimize its customers’ mobility experience, XPeng develops in-house its full-stack advanced driver-assistance system technology and in-car intelligent operating system, as well as core vehicle systems including powertrain and the electrical/electronic architecture. XPeng is headquartered in Guangzhou, China. In 2021, the Company established its European headquarters in Amsterdam, along with other dedicated offices in Copenhagen, Munich, Oslo, and Stockholm.The Company’s Smart EVs are mainly manufactured at its plant in Zhaoqing and Guangzhou，Guangdong province.

For more information, please visit https://heyxpeng.com.

Industry

Automotive & Mobility

Company Size

1,001-5,000 employees

Headquarters

Guangzhou, CN

Year Founded

2014

Website

xiaopeng.com

Social Media