Hybrid work: 3 days in the office and 2 days remote per week
Requirements Description:
A Data Engineer is responsible for implementing, building, testing, and maintaining the infrastructure and architecture required for the efficient and reliable processing of various types of data. Selected candidate works with Data Analysts, Data Scientists, and other stakeholders to understand the data requirements, identify data sources, and implement the necessary processes to transform and load the data into the target systems. They are also responsible for ensuring the integrity, availability and security of the data throughout its lifecycle, and for continuously optimizing the data pipelines to meet the evolving business needs.
Duties & Role:
Requirements Description:
• Strong understanding of data engineering concepts, including data warehousing, ETL/ELT processes and data governance
• Experience in planning and maintaining data lakes and pipeline processes, both batch-wise and (near) real-time;
• Experience in using of data engineering tools to support development of data science, data analytics and AI applications for both, structured and unstructured, data
• Experience with monitoring and logging tools to ensure the reliability and performance of data pipelines and AI systems.
• Solid understanding of containerization and orchestration tools such as Docker and Kubernetes.
• Experience with cloud platforms such as AWS, Google Cloud or Azure
• Solid understanding of good software development principles such as version control, CI/CD, unit/functional testing.
• Strong proficiency in Python for building and integrating various data engineering components
• Solid understanding of data security best practices, including data encryption, access controls, authentication/authorization mechanisms, and compliance requirement
WLG is here to challenge. To reshape. To change the game.
Our purpose? To facilitate a match made in heaven in the IT industry. Because, with us, you’re more than a number on a spreadsheet.
You’re one of us.
And you’re on a quest to better your experience in the workplace.
For employers, our team of ex-IT specialists and HR professionals can sniff out talent from across the ocean. Combine a bloodline full of talent with drive to strengthen and grow as employees, and we’ll find you the ideal
candidate that’ll last.
For IT specialists who are ready for their next adventure; searching for opportunities, we’re here to make it happen. We use state-of-the-art technology to take away any confusion and show you exactly who you are as a specialist. The more you understand yourself, the more we can pinpoint an IT role that fulfills, stretches and challenges, and allows substantial growth.
