NIO

AI推理引擎开发工程师

NIO  •  Onsite  •  5 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

AI推理引擎开发工程师
北京
社招
全职
数字技术
本科及以上
5-7 年
职位描述
1. 参与大模型推理引擎的设计和研发,支撑自研以及开源模型的快速部署和高性能推理;
2. 通过各种技术手段持续优化性能,降低推理成本,包括但不限于:算子/编译优化、异构推理、分布式并行等;
3. 学习并应用业界前沿的推理优化技术,KV Cache优化、模型量化(Quantization)、剪枝(Pruning),跨机分布式推理优化等;
4. 对 Transformer 架构及主流大模型(如GPT、Llama、Qwen等)的推理特性有基本理解,了解大模型推理的基本流程和常见挑战(如延迟、吞吐、内存占用);
5. 在资深工程师指导下,参与优化内存管理、计算资源分配与调度策略,提升模型推理速度和资源利用率。学习并使用性能分析工具(如Nvidia Nsight)进行瓶颈定位和优化。
职位要求
1. 熟练掌握 C++ 和 Python 编程语言,具备扎实的数据结构、算法和操作系统基础熟悉至少一种主流的深度学习框架(如 PyTorch、TensorFlow),了解其基本实现原理了解GPU编程(如 CUDA)或并行计算,有相关的课程项目或实验经验;
2. 有开源大模型推理框架(vllm/sglang/trt-llm)使用和优化经验者优先;
3. 有cuda或triton开发优化gpu算子经验者优先;
4. 有NVIDIA 等算力芯片优化经验者优先;
5. 有大模型推理相关从业经验者优先。
投递
NIO

About NIO

NIO is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November 2014, NIO’s mission is to shape a sustainable and brighter future together. NIO aims to build a community starting with smart electric vehicles to share joy and grow together with users.

NIO designs, develops, jointly manufactures and sells premium smart electric vehicles, driving innovations in next-generation technologies in autonomous driving, digital technologies, electric powertrains and batteries. NIO differentiates itself through its continuous technological breakthroughs and innovations, such as its industry-leading battery swapping technologies, Battery as a Service, or BaaS, as well as its proprietary autonomous driving technologies and Autonomous Driving as a Service, or ADaaS.

NIO’s models for sale include the all-new smart electric flagship SUV ES8, the smart electric flagship coupe SUV EC7, the smart electric mid-large SUV ES7, the smart electric flagship sedan ET7, the all-new smart electric all-round SUV ES6, the all-new smart electric coupe SUV EC6, the smart electric mid-sized sedan ET5, and the smart electric tourer ET5T.

Industry
Unknown
Company Size
5,001-10,000 employees
Headquarters
Jiading, CN
Year Founded
Unknown
Website
nio.com
Social Media