Job Description

Senior AI Engineer (LLM & Distributed Systems)

We are building AI-powered backend platforms and are hiring a Sr. AI Engineer with backend/distributed-systems focused.

This is a hands-on engineering role focused on scalable backend architecture, LLM integration, and reliable AI system deployment.

What You’ll Work On

• Design and build scalable backend services and RESTful APIs using Python (FastAPI).
• Develop distributed, high-throughput, low-latency systems integrating AI/LLM services, SQL databases, and Kafka pipelines.
• Integrate and operationalize LLM solutions (prompt orchestration, evaluation, monitoring, caching, optimization).
• Build containerized services using Docker and deploy via Kubernetes.
• Ensure reliability, observability, performance, and security across production systems.
• Contribute to CI/CD pipelines and production deployment health.
• Collaborate cross-functionally with AI engineers, data teams, product, and business stakeholders.
• Write clean, modular, well-tested production code and participate in code reviews.

Education

- Bachelor’s degree in computer science, Software Engineering, or related field (or equivalent practical experience).

Required Experience

• 5+ years backend engineering experience.
• Deep expertise in Python and API development (FastAPI preferred).
• Strong experience with Kafka or event-driven architectures.
• Experience designing distributed, high-throughput systems.
• Experience integrating backend services with data platforms such as Databricks
• Strong debugging, performance optimization, and observability practices.
• Experience with Docker, Kubernetes, CI/CD pipelines.
• Experience working in distributed, cross-functional teams.
• Solid testing discipline (unit + integration).
• Excellent communication skills, able to explain technical decisions clearly to business and architecture stakeholders.

Nice to Have

• Experience defining system architecture and evaluating trade-offs.
• Cloud exposure (Azure DataBricks preferred).
• Experience in regulated environments (e.g., insurance).
• Full-stack exposure.

Chubb Canada does not use artificial intelligence (AI) tools to assess, screen, or select applicants.

At Chubb we are committed to providing equal employment opportunities to all employees and applicants. It is our policy to provide equal employment opportunities to employees and applicants based on job-related qualifications and ability to perform a job. If you require an accommodation during the hiring process or upon hire, please inform Human Resources. If a selected applicant requests accommodation during the recruitment process, Chubb will consult with the applicant in order to provide suitable accommodation that takes into account the applicant’s accessibility needs.