Data Engineer With Data Bricks- GCH -
Data Bricks
Design & Build Data Pipelines Develop, optimize, and manage large-scale data engineering workflows using Databricks and Apache Spark, ensuring scalable and efficient data processing.
Data Lake & Delta Lake Build and manage lake houses/data lakes using Databricks Delta Lake to ensure high-performance, scalable, and reliable storage for structured and unstructured data.
Collaboration with Cross-Functional Teams Work with data scientists, analysts, and business stakeholders to understand data needs, provide insights, and deliver solutions using Databricks.
Performance Tuning & Optimization Tune and optimize Spark-based jobs and other Databricks workflows for high performance and low latency across large datasets.
Data Integration Integrate and orchestrate data from multiple sources (e.g., databases, APIs, cloud services) into the Databricks environment, ensuring data quality and consistency.
Cloud Infrastructure Management Leverage cloud platforms (e.g., AWS, Azure, GCP) for efficient use of Databricks clusters, ensuring cost optimization and scalability.
Machine Learning Pipeline Development Collaborate with data scientists to design and implement end-to-end machine learning pipelines, utilizing MLflow for model tracking, versioning, and deployment.
Model Deployment & Monitoring Collaborate on model deployment strategies within Databricks, using MLflow for tracking, managing experiments, and deploying models into production environments.
Automation & CI/CD Implement continuous integration and continuous delivery (CI/CD) pipelines to automate the deployment of data pipelines and machine learning models.
Data Engineer
MINIMUM QUALIFICATIONS/EXPERIENCE (REQUIRED FOR THE JOB)
Zensar stands out as a premier technology consulting and services company, embracing an ‘experience-led everything’ philosophy. We are creators, thinkers, and problem solvers passionate about designing digital experiences that are engineered into scale-ready products, services, and solutions to deliver superior engagement to high-growth companies. This full lifecycle capability – from experience to engineering to engagement – is what makes us unique. This integrated approach also means that we harness the power of technology, creativity, and insight to deliver impact — ensuring our work focuses not just on technology but also on the people who use it.
Part of the $4.4 billion RPG Group, Zensar is headquartered in Pune, India. Our 10,000+ employees work across 30+ locations worldwide, including Seattle, Princeton, Cape Town, London, Singapore, and Mexico City. As an organization, we are diverse and multi-dimensional and unite across geographies and skill sets to deliver products and services that are value-driven, environmentally conscious, and human-centered.
To know more, visit us at www.zensar.com.
