Job Description
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.
TechOps - CloudOps – AI/ML Platform Operations: Manager
At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.
Join EY and help to build a better working world.
About Global Delivery Services
Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.
Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.
Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.
Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.
Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.
The opportunity
We are looking for an experienced AI/ML Platform Operations Manager to lead a team responsible for the reliable, secure, scalable, and cost-effective operation of enterprise machine learning and generative AI platforms. The role combines people leadership, service delivery management, stakeholder engagement, and strong technical oversight across MLOps, LLMOps, model deployment and monitoring, APIs and endpoints, model pipelines, prompt and model configuration, observability, and incident resolution. The Manager will be accountable for meeting agreed SLAs and KPIs, managing operational risk and critical escalations, developing team capability, and driving continuous improvement across production AI services.
Your key responsibilities
- Lead, coach, and develop a team of AI/ML Platform Operations Engineers, establishing clear responsibilities, objectives, support coverage, competency plans, and performance expectations.
- Own end-to-end service delivery for machine learning and generative AI platforms, ensuring incidents, requests, problems, changes, releases, access activities, and model lifecycle events are managed within agreed SLAs and controls.
- Define, monitor, and report KPIs including platform and endpoint availability, inference success rate, response latency, error rate, mean time to detect, mean time to recover, incident recurrence, change success rate, model and prompt deployment success, token usage, cost efficiency, model quality, drift, safety events, and stakeholder satisfaction.
- Review operational dashboards, model and service telemetry, support backlogs, demand trends, and risk indicators, and drive recovery plans, corrective actions, automation, and measurable service improvements.
- Act as the senior escalation point for critical issues involving model deployments, LLM services, APIs and endpoints, model pipelines, prompt and model configuration, observability, security controls, quotas, latency, scaling, and cloud dependencies.
- Provide technical governance for MLOps and LLMOps practices covering experiment tracking, model registration, validation, approval, promotion, deployment, rollback, retirement, prompt versioning, evaluation, and operational monitoring.
- Lead major incidents, including business-impact assessment, technical coordination, executive communication, service restoration, root cause analysis, and corrective-action tracking.
- Drive problem management for recurring endpoint failures, performance degradation, model-quality regression, drift, unsafe responses, pipeline instability, quota constraints, and cost anomalies.
- Oversee production API and endpoint operations covering authentication, authorization, throttling, quotas, retries, timeouts, autoscaling, load management, high availability, private networking, and secrets management.
- Ensure effective observability across logs, metrics, traces, dashboards, alerts, service-level indicators, model quality, groundedness, safety, hallucination risk, user feedback, token consumption, and cost.
- Govern prompt templates, system instructions, model parameters, routing rules, guardrails, content filters, retrieval configuration, tool connections, and environment-specific configuration through approved change controls.
- Manage team capacity, shifts and on-call coverage, work allocation, cross-training, succession planning, demand forecasting, and operational readiness for new AI use cases.
- Establish and enforce runbooks, SOPs, monitoring and evaluation standards, known-error records, architecture and dependency documentation, escalation paths, and knowledge-management practices.
- Provide technical oversight for Python-based automation, API integrations, operational tooling, evaluation workflows, health checks, and incident diagnostics.
- Provide regular leadership and service reviews covering SLA and KPI performance, risks, major incidents, model and prompt changes, capacity, spend, technical debt, and improvement actions.
Skills and attributes for success
- Strong people-management and service-delivery leadership, with experience managing AI/ML, platform engineering, DevOps, or cloud operations teams supporting business-critical services.
- Deep operational understanding of MLOps and LLMOps, including model lifecycle management, deployment strategies, prompt configuration, evaluation, observability, reliability, security, and cost controls.
- Strong technical knowledge of model APIs and endpoints, authentication, rate limits, quotas, autoscaling, latency, high availability, monitoring, and incident troubleshooting.
- Working knowledge of OpenAI services, AWS Bedrock, and Python sufficient to guide investigations, review designs, and challenge technical findings or remediation plans.
- Demonstrated ability to translate SLAs, risk requirements, and business expectations into measurable KPIs, operational dashboards, team goals, and improvement roadmaps.
- Experience leading major incidents, escalations, root cause analysis, problem management, change governance, release management, and senior stakeholder communication.
- Strong understanding of responsible AI, model risk, privacy, prompt injection, data leakage, content safety, evaluation, traceability, auditability, and human oversight.
- Ability to balance platform reliability, model quality, security, delivery velocity, cost, technical debt, innovation, and team development.
- Strong leadership behaviours including accountability, coaching, delegation, decision-making, conflict resolution, and collaboration across distributed teams.
To qualify for the role, you must have
- Bachelor’s degree in computer science, artificial intelligence, machine learning, data science, engineering, or a related discipline, or equivalent professional experience.
- 10–14 years of relevant experience in platform engineering, DevOps, cloud operations, data engineering, machine learning engineering, or production support.
- At least 3 years of experience leading or managing AI/ML platform, MLOps, LLMOps, DevOps, or cloud operations teams.
- Strong hands-on or technical leadership experience with MLOps pipelines, production model deployment, monitoring, rollback, and lifecycle governance.
- Strong experience overseeing LLMOps, including model endpoints, prompt and model configuration, evaluation, observability, guardrails, and incident resolution.
- Experience supporting OpenAI-based services, AWS Bedrock, or comparable enterprise foundation-model platforms.
- Experience owning SLA-based production services and reporting reliability, model quality, safety, performance, capacity, cost, and operational KPIs to leadership.
- Experience managing major incidents, root cause analysis, problem records, changes, releases, audits, responsible AI reviews, disaster recovery, and continuous improvement.
- Practical Python and API knowledge sufficient to oversee automation, integration, evaluation, and troubleshooting activities.
- Experience managing staffing, workload, on-call coverage, capability development, performance objectives, vendors, and stakeholder expectations in a global delivery model.
Technologies and Tools
Must have
- MLOps: experiment tracking, model packaging, model registry, evaluation gates, approval workflows, deployment strategies, monitoring, rollback, lineage, and lifecycle management.
- LLMOps: foundation model endpoints, prompt and model configuration, evaluation, retrieval-augmented generation, embeddings, guardrails, observability, token and cost management, and production support.
- Model serving and API operations: REST APIs, streaming, endpoint security, authentication, quotas, rate limits, retries, timeouts, autoscaling, load balancing, latency, availability, and disaster recovery.
- Observability and evaluation: logs, metrics, traces, dashboards, alerting, service-level indicators, quality measures, groundedness, drift, safety monitoring, user feedback, token consumption, and cost reporting.
- OpenAI services and AWS Bedrock for model access, invocation, embeddings, streaming, configuration, quota management, monitoring, security, and operational governance.
- Python for technical oversight of automation, API integration, operational tooling, health checks, evaluation, and incident diagnosis.
- ITIL-aligned service management and KPI reporting across incident, request, problem, change, release, availability, capacity, continuity, security, and service-level management.
Good to have
- Experience with Azure OpenAI, Amazon SageMaker, Microsoft Foundry, Databricks Mosaic AI, MLflow, or comparable enterprise AI and model lifecycle platforms.
- Knowledge of agentic AI and orchestration frameworks such as LangChain, LangGraph, Semantic Kernel, or equivalent technologies, including tool calling, multi-step workflows, memory, and human-in-the-loop controls.
- Ability to evaluate operational AI-agent use cases, define measurable value, establish approval boundaries, and oversee secure adoption without reducing human accountability.
- Knowledge of Kubernetes, Docker, serverless platforms, API gateways, service mesh, event-driven architectures, Terraform, AWS CloudFormation, or equivalent infrastructure technologies.
- Understanding of AI security and responsible AI standards and practices, including the NIST AI Risk Management Framework, ISO/IEC 42001, privacy, red teaming, evaluation, traceability, and auditability.
- Knowledge of vector databases, retrieval systems, model gateways, caching, feature stores, FinOps, data quality, and model risk management.
- Relevant certifications in AWS Machine Learning, AWS AI Practitioner, Azure AI Engineer, MLOps, Kubernetes, DevOps, cloud architecture, ITIL, or people leadership.
What we look for
- People leaders who build accountable, capable, and collaborative AI platform operations teams while maintaining service quality and employee development.
- Service owners who use SLA, reliability, model quality, safety, capacity, and cost insights to anticipate risks and deliver measurable improvement.
- Technically credible managers who can guide complex MLOps, LLMOps, model, prompt, API, pipeline, cloud, security, and observability investigations.
- Calm and structured escalation leaders who communicate clearly, restore services quickly, and ensure sustainable corrective action.
- Forward-looking professionals who operationalize emerging AI capabilities while maintaining security, governance, responsible AI, human oversight, and service accountability.
What we offer
At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.
Are you ready to shape your future with confidence? Apply today.
To help create an equitable and inclusive experience during the recruitment process, please inform us as soon as possible about any disability-related adjustments or accommodation you may need.
Our Commitment: As a commitment, we persistently endeavour to embody our values, fulfil our purpose, and champion inclusiveness. Our dedication is to cultivate EY into an environment where diverse perspectives are celebrated, creating a supportive atmosphere for individuals to authentically be themselves and contribute their utmost.
Professional Development: From entry-level employees to senior leaders, we believe in continuous learning. We offer opportunities to build new skills, take on leadership roles, and connect and grow through mentorship.
People and Culture: In our dynamic workplace, diversity, equity, and inclusiveness are ingrained in our culture. We're united by a commitment to create an environment where every individual's differences are valued, practices are equitable, fostering a sense of belonging. Our shared values include integrity, respect, teaming, inclusiveness, energy, enthusiasm, courage to lead, and building relationships based on doing the right thing.
Benefits: Embark on a transformative career journey with us and indulge in a suite of premium benefits, encompassing exclusive health and wellness packages, enticing rewards, and cutting-edge learning opportunities that empower you to continually grow and excel in your professional and personal development.
How to Apply: If you are passionate to join us and are aligned with our commitment to building a better working world, we invite you to apply by completing our user-friendly form with personal and professional information and by providing your consent to data privacy.
Successful candidates advance to a competency-based interview. If mutual interest persists, a job offer awaits.
“We are an equal opportunity employer and are committed to Diversity, Equity & Inclusion”.
EY | Building a better working world
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.