Dida

高级数据获取工程师

Dida  •  Onsite  •  2 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

高级数据获取工程师北京社招全职研发 - 数据挖掘职位描述1. 负责机票行业爬虫体系 0→1 搭建,完成航司、OTA 等核心数据源的爬虫架构设计、开发与落地,构建稳定、高效、可扩展的分布式采集体系;
2. 主导机票数据全链路建设:采集、解析、清洗、校验、存储与质量监控,保障机票基础数据高可用、高准确、高实时;
3. 针对航司复杂反爬、动态加密、接口变更等问题,主导技术攻坚与方案落地,持续优化爬取成功率、性能与稳定性;
4. 负责爬虫团队日常管理、任务规划、技术迭代与风险把控,推动流程标准化,提升团队交付效率与质量;
5. 对接业务需求,制定爬虫策略与演进路线,确保爬虫系统长期适配业务发展与数据源变化。职位要求1. 专科以上学历,计算机相关专业;
2. 5 年及以上机票 / 航旅行业爬虫开发实战经验,有完整机票爬虫项目0→1 搭建与落地经验;
3. 精通 Python 开发,熟练使用 Scrapy/Requests/Asyncio 等爬虫技术栈,具备分布式爬虫架构设计能力;
4. 深入理解各类反爬机制,具备加密逆向、接口分析、验证码处理等实战能力,能独立攻坚高难度数据源;
5. 有爬虫团队管理经验,具备需求拆解、任务规划、项目推进与风险把控能力;
6. 具备成本意识,有航司VCC 等支付经验优先;
7. 具备优秀的问题定位、故障排查能力,能快速应对数据源变更与线上突发问题。
8. 对数据敏感、责任心强,能承受压力,适应航旅行业高频变化的业务与数据源环境。 投递
Dida

About Dida

An AI-first travel technology group. Founded in 2012 and headquartered in Shenzhen, Dida combines the scale and innovation of China with the diverse needs of international travel partners. By leveraging advanced AI platforms, automation and data insights, Dida delivers smarter solutions that help partners improve efficiency, strengthen engagement, and accelerate growth.

As the No.1 B2B player in China and a leader across APAC, Dida is uniquely positioned as the premier gateway between China, APAC, and the global travel ecosystem. Through its core business lines - Dida Hotels, Dida Flights, Dida Go and Dida Experiences - The company connects high-quality travel content from hotels, airlines, and ancillary providers to the world’s travel agencies, TMCs, tour operators, OTAs, and wholesalers - integrating deep partnerships with cutting-edge technology.

Guided by its pillars of Travel, Technology, and New Ventures, Dida Holdings is committed to building stronger partnerships and unlocking new opportunities across the global travel industry.

Industry
Unknown
Company Size
201-500 employees
Headquarters
Guangdong, CN
Year Founded
2012
Website
dida.com
Social Media