Job Description

Job Summary

Job Description – Azure Data Engineer

Position

Azure Data Engineer

Experience

5–8 Years

Location

Offshore (India)

Employment Type

Full-Time

Project

Munich Re APAC – Azure Data Platform (BDAP)

Job Summary

We are seeking an experienced Azure Data Engineer to design, develop, and support enterprise-grade data integration solutions on Microsoft Azure. The candidate will be responsible for building scalable data pipelines using Azure Data Factory (ADF), Azure Databricks, and Azure DevOps while ensuring high performance, security, and compliance. The role requires close collaboration with architects, business stakeholders, and regional IT teams to deliver robust cloud-based data solutions.

Key Responsibilities

Responsibilities

• Design, develop, and maintain Azure Data Factory (ADF) pipelines for data ingestion, transformation, and orchestration.
• Develop Azure Databricks notebooks using PySpark and Spark SQL for large-scale data processing.
• Build and optimize ETL/ELT pipelines to ingest data from SQL Server and other enterprise data sources into Azure Data Lake.
• Implement data movement between Development, UAT, ADP, and Production environments.
• Perform data transformation, cleansing, validation, and reconciliation activities.
• Optimize Databricks workloads for performance, scalability, and cost efficiency.
• Develop reusable frameworks and coding standards for data engineering solutions.
• Collaborate with Solution Architects during solution design and implementation.
• Support Azure DevOps-based CI/CD implementation, repository management, branching strategies, and release deployments.
• Create and maintain technical documentation, deployment guides, and operational runbooks.
• Participate in code reviews and ensure adherence to development standards and best practices.
• Troubleshoot production issues and provide timely resolution.
• Support compliance activities, including IAM, SDF, RACE, and security reviews.
• Work closely with business users, project managers, architects, and infrastructure teams throughout the project lifecycle.

Skill Requirements

• Microsoft Azure Data Factory (ADF)
• Azure Databricks
• PySpark
• Spark SQL
• Azure Data Lake Storage Gen2 (ADLS)
• Azure SQL Database / SQL Server
• Azure DevOps (Repos, Pipelines, CI/CD)
• Git Version Control
• SQL Programming
• ETL/ELT Development
• Data Integration
• Performance Tuning and Optimization
• Data Modelling
• Azure Monitor and Log Analytics
• REST API integration

Other Requirements

Preferred Skills

• Unity Catalog
• Delta Lake
• Microsoft Fabric (Good to Have)
• Synapse Analytics (Good to Have)
• Power BI integration
• Infrastructure as Code (Terraform/Bicep)
• Python scripting
• Agile/Scrum methodology

Domain Experience

• Insurance or Reinsurance domain experience is preferred.
• Experience working in enterprise cloud migration and modernization projects.
• Exposure to financial or actuarial data platforms will be an added advantage.

Soft Skills

• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management.
• Ability to work independently with minimal supervision.
• Strong collaboration and teamwork.
• Ability to work in a global delivery model.

Educational Qualification