Job Description

Job Summary

We are seeking a skilled Data Engineer with hands-on experience in Apache Spark, SQL, and Database technologies to design, develop, and maintain scalable data pipelines and data processing solutions. The candidate will work closely with data architects, business analysts, and analytics teams to enable efficient data ingestion, transformation, and delivery for enterprise reporting and analytics platforms.

Key Responsibilities

Data Engineering & ETL Development

• Design, develop, and maintain scalable ETL/ELT pipelines using Spark.
• Build robust data ingestion frameworks for structured and semi-structured data.
• Develop and optimize batch and near real-time data processing workflows.
• Troubleshoot and resolve data pipeline failures and performance bottlenecks.

Database & SQL Development

• Write complex SQL queries, stored procedures, and data transformation logic.
• Design and optimize database schemas, tables, partitions, and indexes.
• Perform query tuning and performance optimization for large datasets.
• Ensure data integrity, consistency, and quality across source and target systems.

Skill Requirements

Other Requirements