Job Description

Job Title: Data Engineer

Experience: 3–5 Years
Location: Remote

Only CV matching with JD will be Shortlisted

Role Purpose

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines within the Azure ecosystem. You will play a key role in enabling data-driven insights by developing reliable data solutions that support analytics, reporting, and business intelligence initiatives.

Key Responsibilities

• Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF)
• Work with Azure Data Lake Storage (ADLS) for data ingestion, storage, and processing
• Build and optimize data transformations using PySpark and SQL
• Integrate data from multiple structured and unstructured sources
• Ensure data quality, integrity, and consistency across pipelines
• Support implementation of Lakehouse architecture and Medallion (Bronze, Silver, Gold) layers
• Collaborate with analysts and BI teams to enable reporting and data models
• Monitor, troubleshoot, and resolve data pipeline issues
• Document data processes, workflows, and pipeline logic

Required Skills & Experience (3–5 Years)

• Hands-on experience with Azure Data Factory (ADF) and ADLS
• Strong programming skills in PySpark and SQL
• Experience in building and maintaining ETL pipelines
• Working knowledge of structured and unstructured data processing
• Basic understanding of Lakehouse architecture and Medallion framework
• Familiarity with Delta Lake concepts
• Strong problem-solving and debugging skills

Preferred Qualifications

• Experience with Azure Databricks
• Understanding of data modeling and data warehousing concepts
• Exposure to data governance and data quality frameworks
• Experience working in Agile/Scrum environments

Soft Skills

• Strong communication and stakeholder collaboration skills
• Analytical mindset with attention to detail
• Ability to work independently in a remote setup
• Team player with a proactive approach to problem-solving

Career Progression Opportunity

This role provides a pathway to grow into a Senior Data Engineer (5–10 Years) position, where responsibilities include:

• Designing end-to-end data architectures
• Working extensively with Microsoft Fabric and advanced Azure services
• Leading data engineering initiatives and mentoring team members
• Optimizing large-scale distributed data systems