Boardroom Appointments - Global Human and Talent Capital

Data Engineer

Boardroom Appointments - Global Human and Talent Capital  •  Cape Town, ZA (Hybrid)  •  2 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Hybrid position

Minimum requirements:

  • Relevant 3-year tertiary qualification BSC In Computer Science / Information Systems
  • 2-4 Years Senior Data Engineering experience

In depth knowledge and understanding of:

  • Azure Databricks
  • Data governance and data management frameworks
  • BI and Warehouse design
  • Movement of data into the Cloud using the following tools Apache Kafka, Storm, Flume for ingesting data or Amazon Web Services (AWS) Cloud Development Kit (CDK)
  • Operating with real-time streams, data warehouse queries, JSON, CSV, raw data
  • Scripting Data Pipelines for scheduled movement of data
  • Designing and developing ETL/ELT processes and data pipelines Experience working with Azure DevOps
  • Data visualization including PowerBI / Tableau
  • Exploratory Data Analysis - EDA
  • SQL
  • Microsoft SQL Server
  • NoSQL
  • Microsoft SQL Server
  • Python (PySpark)
  • C# , Json- calling APIs
  • PowerShell
  • Apache Spark
  • Kafka
  • Scala
  • Splunk
  • Elk Stack
  • Data Modelling
  • Data warehousing solutions
  • Data pipelines
  • Data Cleansing
  • Terraform

Responsibilities:

  • Work as part of an agile data engineering team
  • Ensure that data systems meet the companys regulatory commitments, and that data is reliable and efficient
  • Support best business capabilities for high performance database solutioning
  • Actively participate in team, cross-discipline and vendor-driven collaboration sessions or forums to increase understanding of the working environment by contribution and participation in the relevant Data Governance Frameworks
  • Partner with Technology, Business and other stakeholders to ensure that database structures, programmes and applications meet business delivery requirements
  • Monitor adherence to processes which support the prescribed data architectural frameworks and ensure development/delivery teams align to the required standards and methodologies
  • Design and implement scalable end-to-end database solutions including:
  • Addressing issues of data migration i.e. validation, clean-up and mapping and consistently apply data dictionaries
  • Data cleanse using databricks
  • Component design and development
  • Identification and resolution of production and application development constraints
  • Integration of new technologies and software into the existing landscape
  • Development data set processes for data modelling, mining and production
  • Optimal utilization of big data
  • Documentation management and disaster recovery
Boardroom Appointments - Global Human and Talent Capital

About Boardroom Appointments - Global Human and Talent Capital

Boardroom Appointments is a global specialist in Recruitment, Contract Staffing, Project Staffing, Temporary Employment Solutions, Training, HR Consultancy and Expatriate Mobility that operates extensively in Africa, EMEA, America, and Europe.

We have been industry leaders since 1989. Our dynamic team of recruitment and labour professionals has serviced hundreds of clients and placed thousands of candidates in various industries across the globe. We have gained invaluable insight and experience into global market trends and human resource workings.

We have specialized divisions that enhance our ability to service all clients in the following industries:

- FMGC

- Finance, Banking and Insurance

- Manufacturing and Processing

- Oil and Gas, Mining, Engineering and Construction

- Medical, Pharmaceutical and Health Care

- Logistics and Supply Chain

- Information Technology, Media and Telecommunications

- Waste Management and Sanitation Services

- Renewable and Alternative Energy

- Retail and Commercial Property

- Agriculture and Production

- Government and Public Services

- Call Centre and Customer Support Services

Today, Boardroom Appointments has a global candidate database and network, servicing clients around the world with all their Human Capital needs.

This experience allows clients to rely on us FULLY for all their talent needs, both permanent and temporary, while they focus on their core business.

We custom design solutions to perfectly fit our client's recruitment needs and form long-lasting relationships based on quality service and flawlessly fulfilled deliverables.

Our team is comprised of passionate and driven individuals who strive to maintain the best and most professional service to our clients.

We are focused, passionate, and we love what we do.

Industry
Unknown
Company Size
51-200 employees
Headquarters
Bedfordview, ZA
Year Founded
1989
Social Media