Line of Service
Advisory
Industry/Sector
Not Applicable
Specialism
Data, Analytics & AI
Management Level
Manager
& Summary
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals.
In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimise business performance and enhance competitive advantage.
Responsibilities:
Data Engineer (Azure Databricks)
Data Engineer with strong hands-on expertise in Azure and Databricks to build, optimize, and operate scalable data pipelines and lakehouse solutions. You will partner with architects, analysts, and business stakeholders to deliver trusted, analytics-ready datasets for insurance use cases.
Key Responsibilities
· Design, build, and support batch and near real-time data pipelines on Azure using standard engineering practices.
· Develop and optimize Databricks notebooks/jobs using PySpark/Spark, SQL, and Python; follow code review, testing, and documentation standards.
· Implement and maintain lakehouse tables (Delta) and curated layers; apply partitioning and file-layout best practices for performance.
· Create orchestration and scheduling using Azure Data Factory and/or Databricks Workflows; manage dependencies, retries, and SLAs.
· Implement data quality checks, observability (logging/metrics/alerts), and incident triage to ensure reliable pipelines in production.
· Apply security and governance controls for regulated/PII data (RBAC, encryption, secrets management) and support audits as needed.
· Tune Spark workloads and manage Azure/Databricks costs (cluster policies, job sizing, caching, indexing/z-order) to meet performance targets.
Required Skills & Qualifications
· Bachelor’s/master’s degree in computer science, Engineering, or related.
· 3–6 years of data engineering experience delivering production pipelines on Azure.
· Strong Databricks expertise (Spark/PySpark), SQL, and Python.
· Hands-on with Azure data services (ADLS Gen2, ADF) and CI/CD using Git-based workflows; familiarity with DevOps practices is a plus.
· Good understanding of data modeling and lakehouse patterns (Delta).
· Strong communication and stakeholder management; ability to translate requirements into scalable data solutions (insurance domain preferred).
Preferred Attributes
· Certifications: Azure Data Engineer Associate and/or Databricks (preferred).
· Exposure to Databricks Unity Catalog/Delta Live Tables and insurance data domains (policy, claims, billing) is a plus; experience with performance/cost optimization is valued.
Mandatory skill sets:
Data Engineer/Azure
Preferred skill sets: Data Engineer/Azure
Years of experience required:
10--12Years
Education qualification:
B.E.(B.Tech)/M.E/M.Tech
Education (if blank, degree and/or field of study not specified)
Degrees/Field of Study required: Master of Engineering, Bachelor of EngineeringDegrees/Field of Study preferred:
Certifications (if blank, certifications not specified)
Required Skills
Data Engineering
Optional Skills
Accepting Feedback, Accepting Feedback, Active Listening, Analytical Thinking, Applied Macroeconomics, Business Case Development, Business Data Analytics, Business Intelligence and Reporting Tools (BIRT), Business Intelligence Development Studio, Coaching and Feedback, Communication, Competitive Advantage, Continuous Process Improvement, Creativity, Data Analysis and Interpretation, Data Architecture, Database Management System (DBMS), Data Collection, Data Pipeline, Data Quality, Data Science, Data Visualization, Embracing Change, Emotional Regulation, Empathy {+ 29 more}
Desired Languages (If blank, desired languages not specified)
Travel Requirements
Not Specified
Available for Work Visa Sponsorship?
No
Government Clearance Required?
No
Job Posting End Date
April 16, 2026
At PwC, we help clients drive their companies to the leading edge. We’re a tech-forward, people-empowered network with more than 370,000 people in 149 countries. Across audit and assurance, tax and legal, deals and consulting we help build, accelerate and sustain momentum. Find out more at www.pwc.com.
PwC: Audit and assurance, consulting and tax services
PwC refers to the PwC network and/or one or more of its member firms, each of which is a separate legal entity. Content on this page has been prepared for general information only and is not intended to be relied upon as accounting, tax or professional advice. Please reach out to your advisors for specific advice.
