Job Description

The Senior / Principal Data Engineer will design, develop, and maintain scalable data platform and analytics solutions across data lakes and operational databases. This role requires hands-on expertise in Azure Databricks, Azure SQL, Python/PySpark, Notebooks, with a strong understanding of data modeling, ETL/ELT best practices, and CI/CD automation in Azure DevOps. The ideal candidate will have a proven record of building robust, efficient, and secure data pipelines that enable analytics, reporting, and AI/ML solutions, preferably in life sciences, clinical research, or healthcare domains.

Requirements

• Design and implement end-to-end data pipelines using Azure Databricks, Azure Data Factory, and ADLS Gen2.

• Build scalable and performant data models for data lakes (Medallion architecture), data warehouses, and operational systems.

• Develop ELT/ETL frameworks for ingestion from APIs, relational sources, flat files, and third-party systems (e.g., Dynamics 365, Veeva, EDC).

• Optimize data transformations, partitioning, and delta lake performance for analytics workloads.

• Leverage Python and PySpark for data ingestion, cleansing, enrichment, and advanced transformations.

• Implement CI/CD pipelines for data workflows using Azure DevOps and Git, including automated testing, deployment, and monitoring.

• Develop and integrate RESTful APIs for cross-system data exchange and automation.

• Collaborate with the BI team to ensure clean, high-quality, and accessible data for the Power BI platform.

• Support semantic modeling, metric layer design, and data governance best practices.

• Enable advanced analytics by provisioning data for ML/AI initiatives and predictive insights.

• Collaborate with product/system owners, analysts, and business stakeholders to translate analytical requirements into technical data solutions.

• Drive best practices in Agile development, version control, and DevOps workflows.

Benefits

Benefits of working at Allucent include:

• Comprehensive benefits package per location
• Competitive salaries per location
• Departmental Study/Training Budget for furthering professional development
• Flexible Working hours (within reason)
• Leadership and mentoring opportunities
• Participation in our enriching Buddy Program as a new or existing employee
• Internal growth opportunities and career progression
• Financially rewarding internal employee referral program
• Access to online soft-skills and technical training via GoodHabitz and internal platforms
• Eligibility for our Spot Bonus Award Program in recognition of going above and beyond on projects
• Eligibility for our Loyalty Award Program in recognition of loyalty and commitment of longstanding employees

Disclaimers:

*Our in-office work policy encourages a dynamic work environment, prescribing 2 days in office per week for employees within reasonable distance from one of our global offices

“The Allucent Talent Acquisition team manages the recruitment and employment process for Allucent (US) LLC and its affiliates (collectively “Allucent”). Allucent does not accept unsolicited resumes from third-party recruiters or uninvited requests for collaboration on any of our open roles. Unsolicited resumes sent to Allucent employees will not obligate Allucent to the future employment of those individuals or potential remuneration to any third-party recruitment agency. Candidates should never be submitted directly to our hiring managers, employees, or human resources.”