Job Description

Job Summary

Job Summary

We are seeking a highly skilled Senior Data Engineer / Lead Data Engineer with expertise in Google Cloud Platform (GCP), Big Data technologies, and Data Engineering to design, develop, and deliver scalable, high-performance data solutions. The ideal candidate will provide technical leadership across the software development lifecycle, drive architecture and design decisions, and work closely with product managers, business stakeholders, and cross-functional engineering teams to enable data-driven business outcomes.

The role requires strong hands-on experience in GCP services (BigQuery, Google Cloud Storage), Spark, Scala, Hive SQL, ETL development, Data Modeling, and Data Lake technologies, along with a solid understanding of software engineering principles, distributed systems, and cloud-native architectures. The candidate will be responsible for building and optimizing large-scale data pipelines, ensuring solution reliability, scalability, and performance while supporting continuous integration and continuous delivery (CI/CD) practices.

Additionally, the successful candidate will contribute to technical strategy, mentor engineering teams, conduct code reviews, develop automation frameworks, and identify opportunities to leverage emerging technologies for solving complex business challenges. Experience with Power BI, DAX, Power Query, semantic data modeling, and business intelligence solutions will be an added advantage.

This position demands excellent analytical, problem-solving, leadership, and communication skills, with the ability to influence technical and non-technical stakeholders and drive continuous improvement across the organization.

Key Technologies

GCP | BigQuery | Google Cloud Storage | Spark | Scala | Hive SQL | ETL | Data Modeling | Data Lake | Jenkins | Git | Maven | CI/CD | Unix/Linux | Power BI | DAX | SQL

Experience

4 to 8+ Years in Data Engineering, Big Data Development, Cloud Data Platforms, and Enterprise Analytics Solutions.

Key Responsibilities

Responsibilities:

• Provide thought leadership, engineering expertise and direction to the engineering teams; be versatile and be able to collaborate with business stakeholders, product teams and cross functional technology groups to drive continuous delivery.
• Drive user story analysis and elaboration, design and develop software applications, and test and build automation tools.
• Own all technical aspects of software development (architecture, design, and development of systems) for assigned applications.
• Perform hands-on software development, writing code, API specs, doing proof of concepts, conducting code reviews, and testing in ongoing sprints.
• Drive consistent development practices - tools and common components.
• Develop deep understanding of tie-ins with other systems and platforms within the supported domains.
• Work with technical product managers contributing to blueprints and assisting with annual planning of feature sets.
• Identify opportunities for adopting new technology to solve existing needs and predicting future challenges.
• Effectively communicate to internal and external business partners on solution design.

Skill Requirements

1. Proficiency in google cloud platform services such as compute engine, app engine, cloud storage, bigquery, and cloud functions.
2. Experience with programming languages like python, java, or node.js for gcp application development.
3. Strong understanding of microservices architecture, containers, and container orchestration tools like kubernetes on gcp.
4. Handson experience in designing and implementing restful apis and integrating third-party services on gcp.
5. Knowledge of ci/cd pipelines, automation tools, and infrastructure as code (iac) on gcp.
6. Excellent problem-solving skills and the ability to work effectively in a fast paced, collaborative environment.
7. Strong communication skills to interact with stakeholders, present technical solutions, and lead discussions on gcp application development strategies.

Other Requirements