Job Description

• Design, develop, and optimise data pipelines using Snowflake services
• Work extensively with Snowflake Internal and External Stages for secure data loading and unloading.
• Develop and manage data ingestion processes using: COPY INTO commands, File formats, Snowpipe if applicable,Data loading from internal stages
• Develop complex SQL queries, stored procedures, tasks, streams, and performance tuning
• Ensure data quality, integrity, and security across systems
• Collaborate with cross functional teams including analysts, BI developers, and stakeholders.
• Use Python for data transformation, automation, and scripting tasks.
• Implement and manage CI/CD pipelines using GitLab CI/CD for automated deployment of data solutions.
• Maintain version control and manage code repositories using GitLab.
• Work with orchestration tools.
• Monitor, troubleshoot, and optimise data pipeline performance issues.