ModelBest

Agentic Infra 私有化交付架构师

ModelBest  •  Onsite  •  19 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Agentic Infra 私有化交付架构师
上海
社招
全职
技术 - 基础架构
职位 ID:A89477
职位描述
1. 负责企业级 Agentic Infra 私有化部署架构设计,覆盖 Kubernetes、GPU / NPU 资源、模型 Serving、对象存储、消息队列、日志监控、权限与网络安全等关键组件。
2. 面向运营商、金融民生等客户复杂 IT 环境,完成部署方案、资源评估、容量规划、网络拓扑、数据安全、容灾与运维方案设计。
3. 负责大模型推理服务、Agent Runtime、RAG 服务、Workflow 编排、工具调用、权限网关、审计日志等能力的工程集成。
4. 针对客户私有化环境中的性能、稳定性、成本和兼容性问题,进行系统级优化,包括推理吞吐、延迟、显存利用、缓存策略、并发控制和服务降级。
5. 建设标准化部署包、环境检查工具、自动化验收脚本等,提升项目交付效率。
6. 与 FDE、解决方案、产品团队协同,将灯塔项目中的部署经验沉淀为可复制的 Agentic Infra 行业交付基线。
职位要求
1. 本科及以上学历,计算机、软件工程、人工智能等相关专业。
2. 3 年以上后端、平台架构、云原生、AI Infra、模型 Serving或企业级私有化交付经验。
3. 熟悉至少一种大模型推理或 Serving 框架,如 vLLM、SGLang、TensorRT、ONNX等。
4. 理解 RAG、Agent Runtime、Tool Use、Workflow 编排、权限与审计等大模型应用基础设施。
5. 具备复杂线上问题排查能力,能从网络、资源、服务、模型、数据、并发和客户环境多维度定位问题。
加分项
1. 有运营商、金融、政企、央国企等客户私有化交付经验。
2. 有 GPU 集群、国产化算力、昇腾 / 昆仑 / 寒武纪等平台适配经验。
3. 有 LLMOps 平台、智能体平台、RAG 平台或模型网关建设经验。
4. 有信创、数据不出域、内外网隔离、权限审计等合规场景经验。
投递
ModelBest

About ModelBest

ModelBest established in August 2022, is an Artificial Intelligence technology company headquartered in Beijing, China. The company is deeply rooted in the field of general AI, with a focus on the innovation and application transformation of large-scale models. ModelBest boasts a prestigious founding R&D team from the Tsinghua in the AI field. Leveraging numerous cutting-edge technologies in natural language processing, the company is currently constructing a large-scale pre-trained model library and corresponding tools, aiming to standardize the technology and applications of large models.

Based on the capabilities of the CPM series of large models, ModelBest has successfully facilitated the intelligent upgrade and efficiency enhancement of various industries. Moreover, the company has released a multi-modal dialog assistant with hundreds of billions of parameters, “Luca", to the public. Adhering to the core philosophy of "intelligence encompassing all", we look forward to exploring and expanding unknown possibilities with global partners, aiming to ensure AI technology serves humanity for a better life in a safe and inclusive manner, laying a solid foundation for the advent of the AGI world.

OpenBMB (Open Lab for Big Model Base,https://github.com/OpenBMB), founded by ModelBest Inc & TsinghuaNLP, aims to build foundation models and systems towards AGI.

Industry
Biotech & Life Sciences
Company Size
11-50 employees
Headquarters
Beijing, CN
Year Founded
2022
Social Media