Cypher Consulting Europe S.L.

Azure Databricks Data Engineer

Cypher Consulting Europe S.L.  •  Prague, CZ (Onsite)  •  18 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

We are looking for an experienced Azure Databricks Data Engineer to help build and operate scalable, production-grade data platforms on Azure Databricks and Microsoft Azure.

The ideal candidate combines strong Spark engineering expertise with a production engineering mindset, treating data pipelines as reliable, enterprise-grade products rather than ad-hoc solutions. This role requires hands-on experience delivering secure, governed, high-performance batch and streaming data platforms at scale.

Tasks

  • Design, build, and maintain scalable batch and streaming pipelines using bronze/silver/gold architectures
  • Develop reusable transformation frameworks and production-grade Spark workloads
  • Implement and optimize Delta Lake solutions, including: ACID transactions, Partitioning strategies, Schema evolution, OPTIMIZE/ZORDER, Incremental and CDC processing patterns
  • Configure and manage Unity Catalog permissions, governance, lineage, and auditability
  • Perform Spark performance tuning and observability monitoring
  • Integrate Databricks with Azure services including ADLS, ADF/Synapse, Key Vault, and Microsoft Entra ID
  • Implement CI/CD pipelines and deployment automation using Azure DevOps or GitHub Actions
  • Collaborate with architects, analysts, data scientists, and engineers to align technical implementation with business needs
  • Continuously improve platform performance, reliability, cost efficiency, and standardization

Requirements

  • Strong hands-on expertise with Azure Databricks engineering

  • Advanced Apache Spark experience using:

  • PySpark or Scala

  • Spark SQL

  • Deep understanding of Delta Lake architecture and optimization techniques

  • Experience building scalable enterprise data platforms and real-time pipelines

  • Strong governance and security experience in multi-team environments

  • Experience with service principals, managed identities, lineage, and auditability

  • Strong troubleshooting and Spark performance optimization skills

  • Azure integration experience across storage, orchestration, and security services

  • Solid CI/CD and Infrastructure-as-Code exposure

  • Comfortable working independently in consulting-style delivery environments

Cypher Consulting Europe S.L.

About Cypher Consulting Europe S.L.

At Cypher Consulting Europe we take pride in our ability to deliver expert recruitment solutions across a wide spectrum of technologies and industry sectors, we deliver specialist consultants and permanent employees to address the business needs of our clients.

In this fast-paced and ever-evolving industry we provide a first-class recruitment service, based around search and selection principals, to ensure we are sourcing the right talent for your specific needs, recruiting qualified candidates who bring genuine value to your business.

At Cypher Consulting Europe we have both the recruitment experience and market knowledge, aligned with the most current and innovative staffing models to ensure we get exceptional results, every time.

Industry
HR & Recruiting
Company Size
1-10 employees
Headquarters
Barcelona, ES
Year Founded
2006
Social Media