Job Description

Mechademy is hiring a Senior Data Engineer to build and scale reliable data platforms, pipelines, and models that power enterprise AI, machine learning, and analytics for industrial asset monitoring and predictive maintenance.

Company Details

Mechademy is an enterprise AI company building real-time monitoring, diagnostics, and predictive maintenance solutions for industrial equipment. The company serves clients across oil & gas, power generation, and LNG sectors through production-grade AI and physics-informed machine learning systems.

Website: https://mechademy.com/

Requirements

• 3–7 years of hands-on experience building production-grade data pipelines

• Strong expertise in SQL, including query optimization and complex transformations

• Strong Python programming skills for data engineering workloads

• Experience with Spark/PySpark or equivalent distributed processing frameworks

• Strong understanding of data modeling, ETL/ELT, CDC, incremental processing, and partitioning

• Experience with workflow orchestration tools such as Dagster, Airflow, or Prefect

• Experience working with AWS or Azure cloud platforms

• Strong focus on data quality, observability, validation, and monitoring

• Experience building scalable datasets for analytics and machine learning use cases

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field

Responsibilities

• Design, build, and maintain scalable batch ETL/ELT and CDC pipelines

• Own data ingestion from client systems into the data platform

• Build reliable, idempotent, incremental, and backfill-safe data pipelines

• Model and transform raw data into trusted analytical and ML-ready datasets

• Develop and optimize Spark/PySpark and SQL workloads for large-scale processing

• Implement data quality checks, lineage, monitoring, and alerting mechanisms

• Support machine learning feature pipelines and analytics platforms

• Optimize storage formats, partitioning strategies, and query performance

• Collaborate with ML, product, and engineering teams to deliver reliable data solutions

• Drive best practices for scalability, reliability, and maintainability across the data stack

Gurugram - Hybrid (2–3 days on-site)

Interview Process

• Technical Round (Python & SQL)

• System Design Round

• Culture Fit Round

Important Note

ClanX is a recruitment partner, helping Mechademy hire a Senior Data Engineer.