Title: Senior Technical Specialist - PBI Databricks
Location: Remote
Duration: 12+ Months
Education: Any Degree
Exp Level: 8+ Years
Job Responsibilities:
Design and build conformed dimensions and transactional fact tables for enterprise reporting.
Develop and maintain data pipelines on A zure Databricks using PySpark, Spark SQL, and Delta Lake.
Implement best practices in dimensional modeling, including:
Star schemas
Conformed dimensions
Surrogate and deterministic hash keys (e.g., SHA-256)
Transactional fact design
Translate existing SQL Server and stored procedure logic into efficient Spark-based transformations.
Implement incremental data processing and change data capture (CDC) pipelines.
Ensure data reconciliation with source systems to meet accuracy and audit standards.
Collaborate closely with a senior Databricks lead to deliver core data assets within defined timelines.
Required Skills:
8+ years of experience in data engineering, with strong focus on Azure Databricks
Proficiency in:
PySpark
Spark SQL
Delta Lake
Deep expertise in dimensional modelling and data warehousing concepts.
Experience with:
Building scalable production pipelines
Incremental data loads and CDC patterns
Performance optimization in distributed systems
Strong understanding of relational databases and ability to interpret complex SQL/stored procedures
Good to have
Experience with:
Lakeflow / Spark Declarative Pipelines or dbt
Unity Catalog
Exposure to financial/General Ledger data models
Familiarity with JD Edwards systems, including:
F0902 (balances)
F0911 (journal details)
Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.
Datavail | Data, Cloud & AI—Built for Real Business Outcomes
Datavail is a data, cloud, and AI consultancy that helps organizations turn complex technology environments into clear, measurable business outcomes.
We partner with data, technology, and IT leaders to make enterprise data more usable, systems more adaptable, and decisions more informed. Our work sits at the intersection of data management, cloud modernization, enterprise applications, and AI—bringing these disciplines together so they support the business, not slow it down.
In a landscape full of tools, platforms, and transformation promises, Datavail focuses on what actually drives progress:
• Trusted, well-managed data that teams can rely on
• Cloud environments without unnecessary cost or complexity
• Enterprise applications that evolve with the business
• Practical, responsible AI that delivers value—not experiments
We help organizations:
• Improve data quality, accessibility, and governance
• Turn analytics and AI into everyday decision-making tools
• Modernize and optimize cloud and application environments
• Reduce operational risk while increasing agility and performance
Our Core Capabilities:
• Data Management & AI: Data foundations, analytics, AI and machine learning that support real-world decisions
• Cloud Services: Cloud modernization, optimization, SRE services, and license optimization
• Enterprise Applications: Managed services, upgrades & integrations, digital transformation, and implementation services
At Datavail, we believe data only creates value when it’s well managed, well understood, and actively used. Our role is to help organizations move from complexity to clarity—and from data to action.
