Job Description

Job Summary

Key Responsibilities:

7 + years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes to provide quality data and analytics solutions

5 + years of experience in Python

2 + years of experience in Apache Spark (PySpark/Spark SQL)

2+ years building and deploying Cloud based solutions using - Azure Databricks with UC, Snowflake, Functions, Service Bus

2+ years of experience in SQL with designing complex data schemas and query performance optimization

Experience with DevOps automation with Terraform.

Experience with CI/CD process and tools – GitHub Actions, GIT, Artifactory, Sonar

Experience with AI/ML LLM

Skill Requirements:

Data Engineering and ETL/ELT processes, Python, Apache Spark (PySpark/Spark SQL), Azure Databricks with UC, Snowflake, Functions, Service Bus, SQL, Terraform. CI/CD process and tools - GitHub Actions, GIT, Artifactory, Sonar, AI/ML LLM experience

Key Responsibilities

1. To be responsible for providing technical guidance / solutions ;define, advocate, and implement best practices and coding standards for the team.
2. To develop and guide the team members in enhancing their technical capabilities and increasing productivity
3. To ensure process compliance in the assigned module| and participate in technical discussions/review as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
4. To prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations.

Skill Requirements

Key Responsibilities:

7 + years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes to provide quality data and analytics solutions

5 + years of experience in Python

2 + years of experience in Apache Spark (PySpark/Spark SQL)

2+ years building and deploying Cloud based solutions using - Azure Databricks with UC, Snowflake, Functions, Service Bus

2+ years of experience in SQL with designing complex data schemas and query performance optimization

Experience with DevOps automation with Terraform.

Experience with CI/CD process and tools – GitHub Actions, GIT, Artifactory, Sonar

Experience with AI/ML LLM

Skill Requirements:

Data Engineering and ETL/ELT processes, Python, Apache Spark (PySpark/Spark SQL), Azure Databricks with UC, Snowflake, Functions, Service Bus, SQL, Terraform. CI/CD process and tools - GitHub Actions, GIT, Artifactory, Sonar, AI/ML LLM experience

Other Requirements

null