NIO

推理框架优化工程师

NIO  •  Onsite  •  1 hour ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

推理框架优化工程师

深圳、上海、合肥、杭州

社招

全职

数字技术

本科及以上

1-3 年

职位描述

  1. 负责大模型推理框架核心组件的方案设计和特性开发 2. 研究投机解码、缓存管理、量化压缩等算法,解决长上下文和高并发难题 3. 探索MoE、PD分离等推理优化技术,与底层硬件深度协同,持续提升性能 4. 参与推理框架的工程化落地,保障线上服务的高可用与高性能

职位要求

· 本科及以上学历,计算机、人工智能、数学、信息、电子等相关专业,1年以上相关经验 · 精通Python或C++,具备扎实的工程能力与系统级性能优化功底 · 理解Transformer架构和推理全链路(注意力计算、缓存机制、采样策略等) · 熟悉至少一种主流推理框架(vLLM/TensorRT-LLM/SGLang等)及其底层实现 加分项(非必需) · 有GPU/NPU等异构计算设备性能调优实战经验,熟悉CUDA/Triton/NCCL等 · 在Speculative Decoding、MoE推理、PD分离、长上下文推理等方向有深度实践 · 熟悉量化、蒸馏、模型压缩等算法,有INT8/FP8量化推理落地经验 · 在vLLM/SGLang/TensorRT-LLM等开源社区有贡献,或在顶会发表过相关论文 · 具备算法研究能力,能跟踪顶会论文并快速复现落地

投递

NIO

About NIO

NIO is a pioneer and a leading company in the premium smart electric vehicle market. Founded in November 2014, NIO’s mission is to shape a sustainable and brighter future together. NIO aims to build a community starting with smart electric vehicles to share joy and grow together with users.

NIO designs, develops, jointly manufactures and sells premium smart electric vehicles, driving innovations in next-generation technologies in autonomous driving, digital technologies, electric powertrains and batteries. NIO differentiates itself through its continuous technological breakthroughs and innovations, such as its industry-leading battery swapping technologies, Battery as a Service, or BaaS, as well as its proprietary autonomous driving technologies and Autonomous Driving as a Service, or ADaaS.

NIO’s models for sale include the all-new smart electric flagship SUV ES8, the smart electric flagship coupe SUV EC7, the smart electric mid-large SUV ES7, the smart electric flagship sedan ET7, the all-new smart electric all-round SUV ES6, the all-new smart electric coupe SUV EC6, the smart electric mid-sized sedan ET5, and the smart electric tourer ET5T.

Industry
Unknown
Company Size
5,001-10,000 employees
Headquarters
Jiading, CN
Year Founded
Unknown
Website
nio.com
Social Media