Job Description

Job Summary

Job Description: Senior Technical Lead – Azure Databricks

We are looking for a Senior Technical Lead with strong expertise in Azure Databricks to lead the design, development, and delivery of scalable cloud-based data engineering solutions. The ideal candidate will have hands-on experience in building modern data platforms on Azure, driving technical excellence, and leading teams to deliver high-quality analytics and data integration solutions.

Key Responsibilities

• Lead the design and implementation of data engineering solutions using Azure Databricks.
• Develop and optimize ETL/ELT pipelines using PySpark and Spark SQL.
• Architect and manage data lakes, data warehouses, and Lakehouse solutions.
• Collaborate with business and technical stakeholders to translate requirements into scalable solutions.
• Provide technical leadership, code reviews, and mentorship to development teams.
• Ensure solution performance, reliability, security, and adherence to best practices.
• Support CI/CD, deployment, and production issue resolution.

Skill Requirements

Must-Have Skills

• Azure Databricks
• PySpark, Spark SQL
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• Delta Lake / Lakehouse Architecture
• Strong SQL and Python programming
• Azure Synapse Analytics
• Azure DevOps and CI/CD
• Data Modeling and Data Warehousing concepts
• Team leadership and stakeholder management

Good-to-Have Skills

• Microsoft Fabric
• Unity Catalog
• Azure Purview
• Kafka / Event Hubs
• Snowflake
• Terraform
• Azure Machine Learning

Databricks Certifications

Other Requirements

Other Requirements

• Proven experience leading technical teams and delivering enterprise-scale data solutions.
• Strong communication, problem-solving, and collaboration skills.
• Experience working in Agile/Scrum environments.