Job Description

About KPMG in India

KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara and Vijayawada.

KPMG entities in India offer services to national and international clients in India across sectors. We strive to provide rapid, performance-based, industry-focused and technology-enabled services, which reflect a shared knowledge of global and local industries and our experience of the Indian business environment.

We are seeking a highly skilled GenAI Architect to design, develop, and deploy Generative AI solutions that drive business innovation and operational efficiency. The role involves working closely with business stakeholders, data scientists, and technology teams to build scalable, secure, and high‑performance AI applications leveraging large language models (LLMs) and related AI frameworks.

Key Responsibilities

• Design, develop, and deploy Generative AI solutions using LLMs (e.g., GPT, Claude, LLaMA, Gemini).
• Build AI-powered applications including chatbots, copilots, summarization, content generation, and RAG (Retrieval-Augmented Generation) systems
• Fine-tune, prompt-engineer, and evaluate LLMs to meet business use cases and performance benchmarks.
• Implement RAG pipelines using vector databases and enterprise data sources.
• Integrate GenAI solutions with existing enterprise systems through APIs and microservices.
• Ensure solutions adhere to security, privacy, compliance, and ethical AI guidelines
• Optimize model performance, latency, and cost efficiency.
• Collaborate with cross-functional teams including Business, TS, Data Engineering, and Cloud teams.
• Document solution design, architecture, and best practices.
• Stay current with emerging trends, tools, and advancements in Generative AI.

Required Skills & Qualifications

• Strong proficiency in Python (mandatory); working knowledge of Java or JavaScript is a plus.
• Hands-on experience with LLMs and GenAI frameworks (LangChain, LlamaIndex, Semantic Kernel, Hugging Face).
• Experience in prompt engineering, fine-tuning, and model evaluation
• Practical knowledge of vector databases (FAISS, Pinecone, Milvus, Weaviate, Chroma).
• Experience with RAG architectures and unstructured data processing.
• Familiarity with REST APIs, microservices, and containerization (Docker, Kubernetes).
• Strong understanding of data privacy, AI governance, and responsible AI practices
• Experience working in Agile/Scrum environments.

• Preferred Qualifications

  • Experience with cloud platforms (Azure OpenAI, AWS Bedrock, Google Vertex AI).
  • Exposure to MLOps/LLMOps pipelines and CI/CD for AI applications.
  • Knowledge of NLP, embeddings, transformers, and deep learning fundamentals.
  • Experience integrating GenAI with enterprise applications, CRM, ERP, orKnowledge Management systems
  • Prior experience in an enterprise or large-scale production environment.

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field

Equal employment opportunity information

KPMG India has a policy of providing equal opportunity for all applicants and employees regardless of their color, caste, religion, age, sex/gender, national origin, citizenship, sexual orientation, gender identity or expression, disability or other legally protected status. KPMG India values diversity and we request you to submit the details below to support us in our endeavor for diversity. Providing the below information is voluntary and refusal to submit such information will not be prejudicial to you.