Job Description

Senior Data Engineer (Azure/Databricks/PySpark) - Hybrid Lisbon (2 days/week office)

ABOUT THE OPPORTUNITY

We are looking for a Senior Data Engineer to join a leading, data-driven organization operating in a modern cloud environment. This opportunity is ideal for professionals passionate about building scalable data platforms and working with cutting-edge technologies within the Microsoft Azure ecosystem.

You will play a key role in designing and delivering robust data solutions that support critical business decisions. This is a highly technical position requiring strong ownership, a hands-on mindset, and experience working in production-grade environments.

PROJECT & CONTEXT

You will be part of a growing data platform team focused on developing and optimizing a modern data lakehouse architecture The environment leverages Azure Data Factory v2, Azure Synapse Analytics, and Azure Databricks (runtime 13.x+), enabling large-scale data processing and advanced analytics.

The project involves working with complex data pipelines, integrating multiple data sources, and ensuring high performance and reliability across the platform. There is also a strong emphasis on DevOps practices, including CI/CD pipelines using Azure DevOps, as well as ongoing adoption of Microsoft Fabric capabilities.

WHAT WE'RE LOOKING FOR (Required)

• 
  Proven experience as a Senior Data Engineer in production environments
• 
  Strong expertise in ETL/ELT pipeline development
• 
  Hands-on experience with Azure Data Factory v2, Azure Synapse Analytics, and Azure Databricks (Spark 3.x)
• 
  Solid experience processing large datasets using Python (3.x) and PySpark
• 
  Advanced knowledge of SQL (T-SQL or ANSI SQL)
• 
  Strong understanding of data modeling techniques (relational and dimensional)
• 
  Experience implementing CI/CD pipelines using Azure DevOps
• 
  Familiarity with data lake / lakehouse architectures
• 
  Ability to gather business requirements and translate them into scalable technical solutions
• 
  Experience working across the full data lifecycle (design, development, deployment, maintenance)
• 
  Fluent in English (mandatory)

NICE TO HAVE (Preferred)

• 
  Experience with Microsoft Fabric
• 
  Knowledge of Dynamics 365 Finance & Operations (D365 F&O) data integration
• 
  Familiarity with Azure Synapse Link
• 
  Experience with Power BI for data validation and visualization
• 
  Exposure to infrastructure-as-code (IaC) or advanced DevOps practices
• 
  Experience in highly regulated or data-intensive industries