Job Description
We are looking for an experienced Technology Engineer with strong expertise in Cloudera CDP, Hadoop ecosystem, DevOps, OpenShift, and CI/CD to support enterprise Technology Platforms & Data Platforms initiatives.
The ideal candidate should possess hands-on production support experience, platform engineering expertise, automation capabilities, and strong knowledge of containerized data platforms. This role requires ownership of Cloudera platform administration, performance optimization, infrastructure automation, observability, and CI/CD implementation within large-scale enterprise environments.
Requirements
Key Responsibilities
- Provide Tier-2 production support for enterprise Cloudera CDP environments.
- Install, configure, administer, and maintain Cloudera Data Platform (CDP) clusters.
- Perform installation, upgrades, patching, and maintenance of CDP 7.1.9 (or latest versions).
- Administer and support Cloudera Data Services (CDS) 1.5.4 / 1.5.5 and latest releases.
- Enable and maintain enterprise security controls across Cloudera CDP environments.
- Optimize Hadoop cluster performance, resource utilization, and overall platform stability.
- Collaborate with Data Engineering teams to optimize Spark workloads and improve application performance.
- Troubleshoot and resolve production issues related to:
- Spark Jobs
- Hive Jobs
- YARN Jobs
- Support CDP containerization using Cloudera Data Services.
- Design, develop, and maintain infrastructure automation for platform operations.
- Build and maintain automated CI/CD pipelines for analytics and data engineering workloads.
- Automate infrastructure provisioning, deployment, configuration management, and operational tasks.
- Implement observability, monitoring, logging, and alerting solutions for platform health.
- Automate security, compliance, and regulatory validation processes.
- Plan and execute automated patch management across enterprise environments.
- Work closely with Infrastructure, DevOps, Security, Data Engineering, and Platform teams to ensure reliable platform operations.
- Participate in Agile ceremonies and contribute to continuous engineering improvements.
Required Technical Skills
Cloudera & Hadoop
- Strong hands-on experience supporting Cloudera CDP production environments.
- Experience with:
- Cloudera Data Platform (CDP)
- CDP 7.1.9 or latest versions
- Cloudera Data Services (CDS) 1.5.4 / 1.5.5
- Hadoop ecosystem administration.
- Spark administration and performance optimization.
- Hive administration and troubleshooting.
- YARN administration and troubleshooting.
- Cluster installation, upgrades, maintenance, and optimization.
DevOps & Automation
Strong experience with:
- Ansible
- Shell Scripting
- Terraform
- Groovy
- Python automation
Experience developing infrastructure automation and operational workflows.
CI/CD
Hands-on experience building and managing automated pipelines using:
- GitHub Actions
- Jenkins
- ArgoCD
Experience implementing CI/CD for data engineering and analytics workloads.
Containers & Platform Engineering
Hands-on experience with:
- Docker
- Podman
- Kubernetes
- OpenShift (OCP)
Experience deploying and managing containerized data platform environments.
Observability & Monitoring
Experience implementing:
- Platform monitoring
- Logging
- Alerting
- Observability frameworks
- Performance monitoring
Security & Infrastructure
Experience with:
- CDP security implementation
- Authentication & authorization
- Security hardening
- Automated security checks
- Regulatory compliance automation
- Automated patch management
Operating Systems & Version Control
- Linux system administration
- Linux networking fundamentals
- Git version control
- Source code management best practices
Required Competencies
- Strong production support experience within enterprise environments.
- Excellent troubleshooting and root cause analysis skills.
- Strong understanding of distributed data platforms.
- Ability to optimize platform performance and reliability.
- Strong ownership mindset with focus on operational excellence.
- Excellent communication and stakeholder collaboration skills.
- Ability to work effectively in Agile engineering environments.
- Experience working across Infrastructure, DevOps, and Data Engineering teams.
- Strong analytical and problem-solving capabilities.
Preferred Experience
- Enterprise Data Platform Engineering.
- Large-scale Hadoop & Cloudera environments.
- Data Platform Operations.
- Platform Automation & Infrastructure as Code.
- DevOps Engineering.
- Cloud-native platform engineering.
- OpenShift-based enterprise deployments.
