ModelBest

大模型评测算法

ModelBest  •  Onsite  •  21 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

大模型评测算法
北京
社招
全职
技术 - 算法
职位 ID:A00198
职位描述
本职位将及时跟踪AIGC技术前沿,承担高性能基础模型与创新应用的效果评估工作,驱动模型迭代与优化,直接影响前沿技术落地效果与用户体验:
1、研究并跟踪国内外最新的大模型技术进展,搭建和维护科学、高效、可扩展的模型评测体系;
2、深入参与团队内部模型训练的性能分析与评估,尤其聚焦在基础模型、多模态(图像、语音、Agent)和前沿技术(如强化学习对齐、Prompt工程)等方向的能力定量分析;
3、分析评测结果,挖掘模型潜在瓶颈并提出改进建议,持续提升模型的质量与用户体验;
4、参与制定模型评测的中长期规划,推动评测工具与流程自动化和标准化,构建业界领先的评测体系。
职位要求
1、计算机、人工智能相关专业本科及以上学历;
2、具备2年以上机器学习、数据挖掘或算法评测相关工作经验,熟悉当前前沿模型的评测方法和指标体系,能力优秀的同学可适当降低年限要求;
3、具备深厚的机器学习、自然语言处理、多媒体理解、语音合成、数据挖掘理论功底,能够深入理解并独立设计评测方案;
4、熟练掌握Python/Java/C++中至少一种编程语言,熟悉常见深度学习框架(如PyTorch、TensorFlow)以及常见的评测框架(如OpenCompass/VLMEvalKit/EvalScope等等);
5、具备优秀的分析问题与解决问题的能力,对前沿技术具备敏锐的洞察力。
加分项:
1、有大模型训练、模型应用落地和性能优化相关经历;
2、有大规模模型评测框架搭建或优化经验,或者熟悉业界主流评测工具与方法者;
3、在NeurIPS、ICML、ACL、SIGKDD、CVPR等国际顶级会议上发表论文,或有相关竞赛获奖经历者。
投递
ModelBest

About ModelBest

ModelBest established in August 2022, is an Artificial Intelligence technology company headquartered in Beijing, China. The company is deeply rooted in the field of general AI, with a focus on the innovation and application transformation of large-scale models. ModelBest boasts a prestigious founding R&D team from the Tsinghua in the AI field. Leveraging numerous cutting-edge technologies in natural language processing, the company is currently constructing a large-scale pre-trained model library and corresponding tools, aiming to standardize the technology and applications of large models.

Based on the capabilities of the CPM series of large models, ModelBest has successfully facilitated the intelligent upgrade and efficiency enhancement of various industries. Moreover, the company has released a multi-modal dialog assistant with hundreds of billions of parameters, “Luca", to the public. Adhering to the core philosophy of "intelligence encompassing all", we look forward to exploring and expanding unknown possibilities with global partners, aiming to ensure AI technology serves humanity for a better life in a safe and inclusive manner, laying a solid foundation for the advent of the AGI world.

OpenBMB (Open Lab for Big Model Base,https://github.com/OpenBMB), founded by ModelBest Inc & TsinghuaNLP, aims to build foundation models and systems towards AGI.

Industry
Biotech & Life Sciences
Company Size
11-50 employees
Headquarters
Beijing, CN
Year Founded
2022
Social Media