Wolters Kluwer

Lead Data Engineer

Wolters Kluwer  •  Pune, IN (Onsite)  •  4 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Lead Data Engineer

We are seeking a highly experienced Lead Data Engineer to drive the design, development, and evolution of scalable data platforms on Azure. In this role, you will lead the architecture and implementation of modern data pipelines, real-time data processing systems, and lakehouse solutions, enabling efficient ingestion, transformation, and storage of structured and unstructured data. You will work closely with data architects, business stakeholders, and engineering teams to build reliable, high-performance data solutions that support advanced analytics and business decision-making.

In addition to strong technical leadership, this role includes people management and delivery ownership for a Scrum team of data engineers. You will be responsible for guiding the team, driving execution, ensuring high-quality deliverables, and fostering best practices across data engineering, governance, and operational excellence. The ideal candidate combines deep expertise in big data technologies, Azure data ecosystem, and data modeling with strong leadership, communication, and stakeholder management skills to successfully deliver complex, enterprise-scale data initiatives.

Preferred Qualifications :

• Bachelor's degree in computer science, Engineering, or equivalent experience.

Must have :

  • 12+ years of experience in enterprise software development. Min 8+ years of experience in data engineering, or data platform design.
  • 5+ years of building data pipelines for structured and un-structured data.
  • 2+ years of experience of azure data pipeline development.
  • 3 + years of experience with Hadoop, Azure Databricks, Stream Analytics, Eventhub, Kafka.
  • 3+ years of experience of relational and dimensional data modeling with SQL Server and data warehouse.
  • 3+ years of experience with SQL Server, T-SQL, stored procedure development and database optimization.
  • 3+ years of experience with MS BI stack (SSIS/SSRS/SSAS, Power BI).
  • 2 + years of experience with Azure data platform (Azure data factory, Azure data lake, Azure SQL DB, Azure DW/Synapse).
  • 2 + years of experience with Azure ML, Python, Scala
  • 3+ years of experience with big data technologies.
  • 2 + years of experience with Power BI, Azure Analysis Services
  • Experience with working with business stakeholders, requirements & use case analysis.
  • Strong communication and collaboration skills with creative problem-solving skills.

ESSENTIAL DUTIES AND RESPONSIBILITIES

  • Participate, collaborate and lead team of data engineers
  • Understand and review the business use cases for data pipelines for the Data Lake including ingestion, transformation and storing in the Lakehouse.
  • Design and develop highly optimized and reliable enterprise level data pipelines to move data to data warehouse in real-time.
  • Review and analyze existing business process, identify any gaps, and recommend improvements.
  • Design and develop modern real-time solutions with Scala, Spark, Azure Databricks.
  • Improve data governance and operational excellence.
  • Develop data expertise and take ownership of data quality for the newly developed pipelines.
  • Adhere to company coding standards and best practices.
  • Conduct code reviews and create technical solution document.
  • Work closely with engineering manager and leadership to align with technical execution of the project(s)
  • Work closely with Data Architects to understand technical roadmap and able to influence if any gaps in the implementation.

Our Interview Practices

To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.

Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.

Wolters Kluwer

About Wolters Kluwer

Wolters Kluwer (EURONEXT: WKL) is a global leader in information, software solutions, and services for professionals in healthcare; tax and accounting; financial and corporate compliance; legal and regulatory; corporate performance and ESG. We help our customers make critical decisions every day by providing expert solutions that combine deep domain knowledge with technology. Wolters Kluwer reported 2024 annual revenues of €5.9 billion. The group serves customers in over 180 countries, maintains operations in over 40 countries, and employs approximately 21,000 people worldwide. The company is headquartered in Alphen aan den Rijn, the Netherlands.

Equal Opportunity Employer

To ensure we continue to drive innovation that enables us to develop products and services to best serve our customers, we cultivate a workplace culture rooted in mutual respect, bringing forward insights from a wide range of backgrounds, perspectives, and experiences. We are also committed to complying with laws requiring equal opportunity in hiring, promotion, and other employment decisions.

All qualified applicants will receive consideration without regard to race, color, religion, sex (including pregnancy, gender identity, transgender status, and sexual orientation), national origin, disability, age, genetic information, veteran status, or any other characteristic protected by applicable law, and we do not tolerate discrimination on any of these bases.

Beware of Recruitment Fraud! 🔒

Scammers may pose as Wolters Kluwer, offering fake job opportunities and requesting personal info or payments. Protect yourself:

- Apply only via our secure Workday hub on our Careers page.

- Our recruiters never ask for banking info or payments.

- We don't use public email accounts (e.g., Hotmail, Yahoo, Gmail).

Report suspected fraud: thirdpartyincident@wolterskluwer.com. If you've made a payment, contact local authorities.

Read more here - https://careers.wolterskluwer.com/en/recruitment-fraud-alert

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Alphen aan den Rijn, NL
Year Founded
1836
Social Media