Job Description

Location: Cape Town (In-Office)

Are you passionate about building impactful digital products that reach millions daily? Our client, a top-tier South African company is looking for a talented and experienced Senior Cloud Data Engineer to join their innovative, cross-functional team. You'll work on high-scale systems in the cloud, wrangle complex datasets, and contribute to products that inform, entertain, and inspire.

Key Responsibilities:

You will be working primarily within the Google Cloud Environment using a variety of the tools that Google offers from Biquery and Dataproc to Kubernettes and AI Hub. You should ideally dream in Python and speak SQL. You should not be afraid to dive into dirty data and help the team make sense of it.

Required Qualifications & Experience:

• Honours/Master's degree in Computer Science or Software Engineering
• 5+ years development experience working with Python
• Data skills (Traditional SQL and No-SQL)
• Large scale ETL
• High scale Restful Services
• Cloud experience (Google cloud platform preferred)
• Experience with source control (Git)

Beneficial Skills:

You will be exposed to these in their environment, great if you have it but not a problem if you don't.

• Scheduling and Orchestration (Airflow/Composer)
• Containerisation (Kubernetes, Docker)
• BigQuery
• Elastic search
• Data Warehousing concepts
• Data governance Concepts.
• Apache beam (Cloud Dataflow)
• Apache Spark (Dataproc)