RayNeo

大模型/AI产品评测工程师

RayNeo  •  Onsite  •  1 hour ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

大模型/AI产品评测工程师

深圳

全职

研发 - 测试

职位描述

负责AI产品/大模型能力评测体系从0到1建设,制定评测标准、指标与流程; 设计并迭代Benchmark数据集,覆盖模型能力、Agent任务、端到端体验; 建立人工评测、自动化评测、LLM-as-a-Judge等组合评测方法论; 搭建评测流水线与质量看板,推动评测结论闭环到产品迭代; 对Bad Case结构化归因,输出优化建议并验证修复效果。

职位要求

3年以上AI评测/算法测试/测试开发经验,有大模型或Agent评测经验优先; 有评测体系或评测基建从0到1搭建经验; 熟悉人工评测、自动化评测、LLM-as-a-Judge等方法,具备评测一致性校验经验; 熟练Python,能独立开发评测工具与数据处理流程; 有较强体系化思维和跨团队推动能力。

投递

RayNeo

About RayNeo

RayNeo, incubated by TCL Electronics (1070.HK), is an industry leader in AR innovation, developing some of the world’s most revolutionary AR consumer hardware, software and applications. RayNeo specializes in the research and development of AR technologies with industry-leading optics, display, algorithm and device manufacturing.

Industry
Hardware & Semiconductors
Company Size
11-50 employees
Headquarters
Shenzhen, CN
Year Founded
2021
Website
rayneo.cn
Social Media