Boardroom Appointments - Global Human and Talent Capital

Data Platform Engineer

Boardroom Appointments - Global Human and Talent Capital  •  Johannesburg, ZA (Hybrid)  •  4 months ago
Apply
Save Job
Mark Applied Mark Interviewed Mark Offered
Hide Job Report Job
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Data Platform Engineer - 12 Month Contract

Key Responsibilities
Platform Engineering & Development
  • Design, implement, and maintain Big Data platforms (e.g., Hadoop, Spark, Kafka) used across the CIB environment.
  • Build robust batch and real-time data ingestion pipelines using tools like Apache NiFi, Airflow, Spark, and Kafka Streams.
  • Maintain and enhance enterprise data lakes and warehouse environments using technologies such as Hive, Delta Lake, and Azure Synapse.
️ Cloud & Hybrid Integration
  • Architect and deploy data platform solutions on Microsoft Azure (Databricks, Azure Data Lake Storage, Synapse Analytics).
  • Build hybrid cloud systems to integrate on-premises and cloud-based data infrastructure.
  • Ensure optimal performance, scalability, and cost-efficiency across cloud workloads.
️ Data Governance, Compliance & Security
  • Ensure platform compliance with data governance and privacy regulations (POPIA, GDPR, BCBS239).
  • Implement robust security controls across infrastructure including encryption, access controls, and audit logging.
  • Work closely with data stewards and governance teams to integrate metadata management and data cataloging tools.
Automation & DevOps
  • Develop and maintain CI/CD pipelines for automated testing, deployment, and monitoring of data solutions.
  • Automate infrastructure provisioning using tools like Terraform and Azure DevOps.
  • Perform routine system administration, performance tuning, and issue resolution across data platforms.
Monitoring & Support
  • Implement monitoring solutions (e.g., Prometheus, Grafana, ELK Stack) to ensure system availability and reliability.
  • Provide L2/L3 support for production data environments, managing incidents and service requests effectively.
Stakeholder Engagement
  • Collaborate with cross-functional teams including data scientists, analysts, developers, and compliance teams.
  • Translate business and analytical requirements into scalable platform solutions.
  • Participate in Agile sprints and architecture design reviews.
Qualifications & Experience
Minimum Requirements
  • Bachelors degree in Computer Science, Information Systems, Engineering, or related field.
  • 5+ years of experience in Big Data engineering or platform operations.
  • Experience in enterprise-grade platforms in banking or financial services.
Technical Skills
  • Strong proficiency with Hadoop ecosystem: HDFS, Hive, Spark, Kafka.
  • Expertise in Azure cloud services: Azure Data Factory, Azure Databricks, Azure Data Lake, Synapse Analytics.
  • Solid programming skills in Python, Scala, Java, and SQL.
  • Familiarity with Terraform, Git, Jenkins, Docker, and Kubernetes.
  • Experience with data governance tools such as Apache Atlas or Collibra is advantageous.
Soft Skills
  • Excellent problem-solving and troubleshooting ability.
  • Strong communication and collaboration skills.
  • Ability to work in a fast-paced, high-stakes environment.
Preferred Certifications
  • Microsoft Certified: Azure Data Engineer Associate
  • Cloudera Data Platform Certified Developer
  • Databricks Certified Data Engineer Associate
  • TOGAF or similar architecture frameworks (advantageous)
Boardroom Appointments - Global Human and Talent Capital

About Boardroom Appointments - Global Human and Talent Capital

Boardroom Appointments is a global specialist in Recruitment, Contract Staffing, Project Staffing, Temporary Employment Solutions, Training, HR Consultancy and Expatriate Mobility that operates extensively in Africa, EMEA, America, and Europe.

We have been industry leaders since 1989. Our dynamic team of recruitment and labour professionals has serviced hundreds of clients and placed thousands of candidates in various industries across the globe. We have gained invaluable insight and experience into global market trends and human resource workings.

We have specialized divisions that enhance our ability to service all clients in the following industries:

- FMGC

- Finance, Banking and Insurance

- Manufacturing and Processing

- Oil and Gas, Mining, Engineering and Construction

- Medical, Pharmaceutical and Health Care

- Logistics and Supply Chain

- Information Technology, Media and Telecommunications

- Waste Management and Sanitation Services

- Renewable and Alternative Energy

- Retail and Commercial Property

- Agriculture and Production

- Government and Public Services

- Call Centre and Customer Support Services

Today, Boardroom Appointments has a global candidate database and network, servicing clients around the world with all their Human Capital needs.

This experience allows clients to rely on us FULLY for all their talent needs, both permanent and temporary, while they focus on their core business.

We custom design solutions to perfectly fit our client's recruitment needs and form long-lasting relationships based on quality service and flawlessly fulfilled deliverables.

Our team is comprised of passionate and driven individuals who strive to maintain the best and most professional service to our clients.

We are focused, passionate, and we love what we do.

Industry
Unknown
Company Size
51-200 employees
Headquarters
Bedfordview, ZA
Year Founded
1989
Website
boardroom.co.za
Social Media