Responsibilities
Requirements
##LI-DNI
Qualifications
Key Responsibilities:
Design, build, and maintain robust ETL/ELT data pipelines using Apache
Spark on Databricks.
Implement data Lakehouse architecture using Delta Lake for cost-effective
data storage and analytics.
Use Databricks Workflows for orchestrating batch and streaming pipelines.
Develop and maintain CI/CD pipelines for data applications using tools such
as Azure DevOps, GitHub Actions or Databricks Repos.
Monitor pipeline performance and troubleshoot data issues in real-time and
batch environments.
Document solutions, workflows, and technical standards.
Required Skills:
Experience in data engineering with a strong focus on Databricks and
Apache Spark.
Proficiency in PySpark, SQL, and Python.
Experience with Delta Lake, Databricks SQL, and Unity Catalog.
Hands-on experience with cloud platforms
Familiarity with data lakehouse architecture, data warehousing and
streaming data
Strong understanding of ETL best practices, data partitioning, and
performance tuning.
Experience with CI/CD for data pipelines.
Excellent problem-solving and communication skills.

WIN Waste Innovations is a waste management company committed to delivering essential waste management solutions to customers and communities supported by our team of 2,100 employees. We believe in preserving our environment for future generations while providing for today’s needs. WIN Waste Innovations is a vertically integrated business with a platform of 50 strategically located collection, transfer and disposal assets. These include waste-to-energy facilities, transfer stations, ash monofills, landfills, and fleets of rail cars and collection vehicles. We process more than 11 million tons of waste annually, converting 6.7 million tons of waste into clean, renewable energy that powers 340,000 homes. We recycle more than 234,000 tons of plastic, paper and metals from the waste stream