MigrationIT

Cloudera Data Platform Engineer

MigrationIT  •  Cairo, EG (Onsite)  •  5 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description


  • Cloudera Infrastructure Design: Design and implement Cloudera infrastructure for data storage, processing, and analytics to meet the platform’s scalability, performance, and security requirements.

  • System Integrations & Automation: Manage system integrations, automation, and CI/CD pipelines to streamline operations and improve platform efficiency.

  • Scalability & Availability: Ensure system scalability, availability, and performance by proactively monitoring the infrastructure and addressing potential issues.

  • Resource Utilization Optimization: Monitor and optimize resource utilization across the platform to ensure efficient operation and reduce costs.

  • Collaboration: Work with cross-functional teams to ensure the platform meets the data and business needs of the organization.

  • Cloudera Administration: Install, configure, and manage Cloudera Hadoop clusters (CDH/CDP).

  • Monitor cluster health using Cloudera Manager.

  • Manage Hadoop ecosystem components: HDFS, YARN, Hive, Impala, HBase, Spark, Kafka.

  • Perform cluster upgrades, patching, and capacity planning

  • Handle performance tuning and troubleshooting.

  • Implement and maintain data security (Kerberos, Ranger, Sentry).

  • Manage backup, disaster recovery, and data replication.


Requirements


  • Education: Bachelor’s degree in computer science, Engineering, or a related field.

  • Experience (3-5 years) : Proven experience with Cloudera infrastructure and containerization technologies such as Kubernetes.

  • Technical Skills: Strong expertise in streaming, KAFKA), and system monitoring tools such as Dynatrace and Grafana.

  • Expertise in designing, implementing, and maintaining scalable infrastructure for data platforms.

  • Proficient with Cloudera and CI/CD automation.

  • Strong experience in system monitoring, performance optimization, and ensuring high availability.

  • Ability to work with cross-functional teams to meet platform needs.
MigrationIT

About MigrationIT

We're a Cairo-based IT recruitment & employment assistance company who endeavor to improve specialized IT recruitment and job finding. Our goal is to ensure that in the vast field of Information Technology the right people are brought into the right place.

Industry
HR & Recruiting
Company Size
11-50 employees
Headquarters
Cairo, EG
Year Founded
2011
Social Media