Job Description

We Are KPMG Israel.

KPMG Israel is more than a professional services firm, we are a community of people driven by impact. As part of a leading global network, we partner with the most influential organizations to drive large-scale business and technology transformation, combining strategic thinking, innovation, and advanced technologies.Guided by integrity, excellence, and forward thinking, we help organizations navigate complexity and create real change. Our people are at the center, with space to lead, experiment, and grow in a dynamic and collaborative environment that connects personal development with meaningful impact on the future of business and society.

About the Role

We’re looking for a hands-on Senior AI Engineer to both build and guide. You’ll architect and ship production GenAI systems while mentoring engineers - keeping one hand on the keyboard and one eye on the roadmap. This isn’t a seat at a whiteboard - it’s a role for someone who can write a RAG pipeline in the morning and run a technical design review in the afternoon.You’ll work on client-facing projects, building AI systems that go live across organizations and industries.

What You’ll Do

• Lead the design and delivery of end-to-end GenAI systems - from prototype to production
• Write production-quality code, review PRs, and set a high engineering bar
• Build and deploy LLM-powered applications (RAG pipelines, agents, fine-tuned models)
• Define architecture patterns for prompt engineering, retrieval pipelines, and model evaluation
• Partner with product, data, and platform teams to deliver real-world AI solutions
• Mentor engineers, contribute to design reviews, and provide technical guidance
• Evaluate and introduce new tools, models, and frameworks

Requirements

What We’re Looking For

• 3+ years of experience in software, ML, or data-related roles
• Hands-on experience building and shipping GenAI / LLM systems in production
• Strong Python skills
• Experience with RAG, agents, fine-tuning, or similar implementations
• Experience with LLM providers (OpenAI, Anthropic, Cohere, or open-source)
• Experience working in cloud environments (AWS / GCP / Azure), with familiarity in MLOps
• Experience leading technical decisions, owning systems, or mentoring engineers

Important Note

We’re looking for engineers who have built GenAI systems that went live. Experience limited to research, academic work, or POCs is less relevant. No formal Tech Lead title is required - what matters is what you’ve actually built, shipped, and owned.