Sr Data Engineer
Company:** Becton, Dickinson and Company (BD)
---
As a Sr Data Engineer at BD, you will be instrumental in designing, building, and maintaining robust and scalable data pipelines and infrastructure. You will apply your expertise to extract, transform, and load critical data from various sources, ensuring high data quality and accessibility for analytics, reporting, and machine learning initiatives across the organization.
---
Job Responsibilities
* Design, develop, and optimize scalable data pipelines (batch and real-time) using various data processing technologies to support analytical and operational needs.
* Implement and maintain data warehousing and data lake solutions, ensuring data integrity, security, and performance.
* Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and translate them into technical specifications.
* Develop and implement data governance standards, including data quality checks, metadata management, and data lineage tracking.
* Monitor and fix data pipeline performance, identify bottlenecks, and implement solutions for continuous improvement.
* Evaluate and recommend new data technologies and tools to enhance BD's data platform capabilities.
* Automate data-related processes, including data ingestion, transformation, and validation.
* Participate in code reviews, provide technical guidance, and mentor junior engineers.
* Ensure compliance with data privacy regulations and internal security policies.
---
Job Qualifications
* Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related technical field.
* +7 years of proven experience in data engineering, with a strong focus on building and maintaining large-scale data platforms.
* Proficiency in at least one major programming language (e.g., Python, Java, Scala) and strong SQL skills.
* Extensive experience with cloud data platforms (e.g., AWS, Azure, GCP) and their relevant data services (e.g., S3, Redshift, Snowflake, Databricks, Azure Data Lake, BigQuery).
* Demonstrated experience with ETL/ELT tools and techniques, and data orchestration platforms (e.g., Airflow, Azure Data Factory).
* Solid understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
* Experience with large-scale data processing technologies such as Spark, or Kafka.
* Familiarity with data governance principles, data quality frameworks, and metadata management.
* Excellent problem-solving skills, with the ability to analyze complex data issues and propose effective solutions.
* Strong communication and collaboration skills, with the ability to work effectively in multi-functional teams.
* Experience with version control systems (e.g., Git) and CI/CD pipelines.
Required Skills
Databricks Delta Live Tables, Databricks Platform, Databricks SQL, Databricks Unity Catalog, Data Engineering, Data Pipelines, Large Scale Data Processing, Microsoft Azure Databricks
Optional Skills
IND Bengaluru - Technology Campus
BD is one of the largest global medical technology companies in the world and is advancing the world of health™ by improving medical discovery, diagnostics and the delivery of care. The company supports the heroes on the frontlines of health care by developing innovative technology, services and solutions that help advance both clinical therapy for patients and clinical process for health care providers. BD and its more than 70,000 employees have a passion and commitment to help enhance the safety and efficiency of clinicians' care delivery process, enable laboratory scientists to accurately detect disease and advance researchers' capabilities to develop the next generation of diagnostics and therapeutics. BD has a presence in virtually every country and partners with organizations around the world to address some of the most challenging global health issues. By working in close collaboration with customers, BD can help enhance outcomes, lower costs, increase efficiencies, improve safety and expand access to health care. For more information on BD, please visit bd.com.
See community guidelines here: https://tinyurl.com/yunjmzkx.
