EY

TechOps-CloudOps-Data Platform and Engineering Support Manager

EY  •  Onsite  •  3 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.

TechOps - CloudOps – Data Platform & Engineering Support: Manager

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.

Join EY and help to build a better working world.

About Global Delivery Services

Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.

Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.

Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.

Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.

Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.

The opportunity

We are looking for an experienced Data Platform & Engineering Support Manager to lead a team responsible for the reliable, secure, and cost-effective operation of enterprise Databricks and data engineering services. The role combines people leadership, service delivery management, stakeholder engagement, and strong technical oversight across Databricks jobs, notebooks, clusters, pipelines, Python and PySpark workloads, ETL and ELT processing, SQL and data issues, performance optimization, and platform administration. The Manager will be accountable for meeting agreed SLAs and KPIs, managing critical incidents and operational risks, developing team capability, and driving continuous improvement across the data platform support service.

Your key responsibilities

  • Lead, coach, and develop a team of Data Platform & Engineering Support Engineers, establishing clear responsibilities, objectives, support coverage, competency plans, and performance expectations.
  • Own end-to-end service delivery for Databricks platform and engineering support, ensuring incidents, requests, problems, changes, releases, and access activities are managed within agreed SLAs and controls.
  • Define, monitor, and report operational KPIs such as platform availability, job and pipeline success rate, SLA attainment, response and resolution time, backlog ageing, first-time resolution, recurrence rate, change success rate, mean time to recovery, compute utilization, cost efficiency, and stakeholder satisfaction.
  • Act as the senior escalation point for critical Databricks issues involving jobs, notebooks, Workflows, Lakeflow or Delta Live Tables pipelines, clusters, SQL warehouses, Unity Catalog, permissions, libraries, runtimes, and integrations.
  • Provide technical oversight for Python, PySpark, Spark, ETL and ELT troubleshooting, data reconciliation, SQL defects, schema changes, data-quality issues, and performance bottlenecks.
  • Lead major incidents, including business-impact assessment, technical coordination, stakeholder communication, service restoration, root cause analysis, and corrective-action tracking.
  • Drive problem management for recurring job failures, platform instability, performance degradation, data issues, and operational gaps, ensuring permanent fixes and preventive monitoring.
  • Oversee Databricks platform administration, including workspace configuration, identity and access, service principals, cluster policies, compute governance, runtimes, libraries, secrets, tokens, Unity Catalog, and secure data access.
  • Ensure controlled deployment and promotion of notebooks, code, jobs, pipelines, configurations, and platform changes using Git, CI/CD, testing evidence, approvals, rollback plans, and post-implementation validation.
  • Manage team capacity, shifts and on-call coverage, work allocation, cross-training, succession planning, demand forecasting, and support readiness for project transitions.
  • Establish and enforce runbooks, SOPs, monitoring standards, reconciliation controls, known-error records, knowledge management, and operational quality reviews.
  • Partner with data engineering, cloud platform, DevOps, security, database, architecture, FinOps, application, and business teams to resolve issues and improve reliability and cost efficiency.
  • Manage vendor and product-support engagement, ensuring complete diagnostic evidence, timely follow-up, and effective resolution of Databricks or cloud-platform defects.
  • Provide regular service reviews and leadership updates covering SLA and KPI performance, risks, major incidents, capacity, cost, technical debt, improvement actions, and planned releases.

Skills and attributes for success

  • Strong people-management and service-delivery leadership, with experience managing technical support or data engineering teams in business-critical environments.
  • Deep operational understanding of Databricks jobs, notebooks, Workflows, pipelines, clusters, SQL warehouses, Spark UI, Delta Lake, Unity Catalog, and production support.
  • Strong technical knowledge of Python, PySpark, Spark architecture, ETL and ELT patterns, data-quality controls, SQL troubleshooting, and workload performance optimization.
  • Demonstrated ability to translate SLAs and business expectations into measurable KPIs, operational dashboards, team goals, and structured improvement plans.
  • Experience leading major incidents, escalations, root cause analysis, problem management, change governance, release management, and senior stakeholder communication.
  • Strong knowledge of Databricks platform administration, identity and access, cluster policies, compute governance, runtime and library management, secrets, service principals, and Unity Catalog.
  • Good SQL skills and working knowledge of Oracle and SQL Server for validation, reconciliation, access investigation, query analysis, and issue diagnosis.
  • Ability to balance operational stability, engineering delivery, security, platform cost, technical debt, team development, and stakeholder priorities.
  • Strong leadership behaviours including accountability, coaching, delegation, decision-making, conflict resolution, and collaboration across distributed teams.

To qualify for the role, you must have

  • Bachelor’s degree in computer science, data engineering, information systems, engineering, or a related discipline, or equivalent professional experience.
  • 10–14 years of relevant experience in data engineering, data-platform operations, ETL development, application management, or production support.
  • At least 3 years of experience leading or managing data engineering, Databricks platform, or production-support teams.
  • Strong hands-on or technical leadership experience with Databricks jobs, notebooks, clusters, Workflows, pipelines, SQL workloads, Delta Lake, and performance troubleshooting.
  • Strong experience overseeing Python, PySpark, Spark, and ETL or ELT troubleshooting in production environments.
  • Experience managing Databricks platform administration, including workspace access, compute configuration, cluster policies, runtimes, libraries, secrets, service principals, and Unity Catalog.
  • Experience owning SLA-based support services and reporting operational, reliability, capacity, cost, and quality KPIs to leadership and business stakeholders.
  • Experience managing major incidents, root cause analysis, problem records, changes, releases, audits, disaster recovery, and continuous improvement.
  • Practical SQL knowledge and working experience with Oracle and SQL Server sufficient to oversee investigations and challenge technical findings.
  • Experience managing staffing, workload, on-call coverage, capability development, performance objectives, vendors, and stakeholder expectations in a global delivery model.

Technologies and Tools

Must have

  • Databricks: workspaces, notebooks, jobs, Workflows, Lakeflow or Delta Live Tables pipelines, clusters, pools, cluster policies, Databricks SQL, SQL warehouses, Spark UI, Delta Lake, and production troubleshooting.
  • Databricks platform administration: users, groups, service principals, entitlements, permissions, secrets, tokens, libraries, runtime management, workspace configuration, compute governance, and access troubleshooting.
  • Unity Catalog: catalogs, schemas, tables, views, volumes, privileges, external locations, storage credentials, lineage, and governed data access.
  • Python and PySpark for technical oversight of ETL development, code troubleshooting, logging, testing, dependency management, exception handling, and performance optimization.
  • ETL and ELT engineering covering batch and streaming ingestion, orchestration, incremental processing, data validation, restartability, reconciliation, and operational recovery.
  • Knowledge of agentic AI and AI-assisted operations, including enterprise AI agents for incident triage, log and Spark analysis, job-failure diagnosis, data-quality investigation, reconciliation, runbook guidance, and knowledge retrieval.
  • Git, CI/CD, and controlled release practices for code, notebooks, jobs, pipelines, platform configurations, and infrastructure changes.
  • ITIL-aligned service management and KPI reporting across incident, request, problem, change, release, knowledge, availability, capacity, continuity, and service-level management.

Good to have

  • Ability to select suitable AI-assisted use cases, define measurable value, implement human-in-the-loop controls, and oversee secure adoption in platform operations.
  • Exposure to Databricks Mosaic AI, Agent Framework, Model Serving, MLflow, Microsoft Copilot Studio, Microsoft Foundry/Azure OpenAI, LangChain, LangGraph, or equivalent technologies.
  • Awareness of responsible AI practices, including human oversight, secure data access, privacy, evaluation, traceability, auditability, and protection against unauthorized automated actions.
  • Experience with Azure or AWS services supporting Databricks, including storage, networking, identity, key management, monitoring, private connectivity, and cost management.
  • Experience with Terraform, Databricks Asset Bundles, REST APIs, CLI tools, scripting, infrastructure as code, data observability, and FinOps.
  • Relevant certifications such as Databricks Certified Data Engineer Professional, Databricks Certified Data Engineer Associate, Databricks platform or administrator credentials, Azure Data Engineer Associate, AWS data engineering certifications, ITIL, Oracle, or Microsoft SQL Server.

What we look for

  • People leaders who build accountable, capable, and collaborative platform-support teams while maintaining a strong focus on service quality and employee development.
  • Service owners who use SLA, reliability, performance, capacity, and cost insights to anticipate risks and deliver measurable improvement.
  • Technically credible managers who can guide complex Databricks, Spark, Python, ETL, SQL, security, and platform investigations.
  • Calm and structured escalation leaders who communicate clearly, restore services quickly, and ensure sustainable corrective action.
  • Forward-looking professionals who introduce responsible AI-assisted and agentic practices without compromising security, governance, or human accountability.

What we offer

At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.

Are you ready to shape your future with confidence? Apply today.

To help create an equitable and inclusive experience during the recruitment process, please inform us as soon as possible about any disability-related adjustments or accommodation you may need.

Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.

Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.

People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.

Benefits: Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.

How to Apply: If you are passionate to join us and are aligned with our commitment to building a better working world, we invite you to apply by completing our user-friendly form with personal and professional information and by providing your consent to data privacy.

Successful candidates advance to a competency-based interview. If mutual interest persists, a job offer awaits.

“We are an equal opportunity employer and are committed to Diversity, Equity & Inclusion”.

EY | Building a better working world

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

EY

About EY

EY is building a better working world by creating new value for clients, people, society, the planet, while building trust in the capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams in more than 150 countries work across a full spectrum of services in assurance, consulting, tax, strategy and transactions, strengthened by sector experience and diverse ecosystem partners.

Find out more about the EY global network: http://ey.com/en_gl/legal-statement

Industry
Consulting & Advisory
Company Size
10,000+ employees
Headquarters
London, GB
Year Founded
Unknown
Website
ey.com
Social Media