AllRecruits

Data Engineer

AllRecruits  •  Hamilton, CA (Hybrid)  •  4 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Data Engineer

We are seeking an experienced and highly motivated Data Engineer to design, build, and maintain scalable, reliable, and high-performing data platforms and pipelines. The ideal candidate will have experience working with large-scale data ecosystems and modern cloud-based data technologies, with a strong focus on data quality, validation, cleansing, and governance.

This role requires a self-directed individual who can work independently, partner with clients and stakeholders, and contribute to strategic initiatives. The successful candidate will be technology agnostic, adaptable to evolving technology landscapes, and passionate about continuously improving processes, standards, and ways of working.

Key Responsibilities

Data Engineering & Architecture

  • Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks.
  • Build and optimize data solutions for processing large volumes of structured and unstructured data.
  • Design and implement modern data architectures that support analytics, reporting, machine learning, and business intelligence initiatives.
  • Ensure data platforms are secure, reliable, scalable, and maintainable.
  • Support real-time and batch data processing requirements.

Data Quality & Governance

  • Develop and maintain data validation, data quality, and data cleansing processes.
  • Implement monitoring, auditing, and alerting mechanisms to ensure data integrity.
  • Identify and resolve data anomalies, inconsistencies, and performance bottlenecks.
  • Establish best practices for data governance, lineage, and metadata management.

Platform Development

  • Develop and support solutions using:
    • Databricks
    • Snowflake
    • Azure Synapse Analytics
    • SQL Server
    • PostgreSQL
    • Cloud and hybrid data platforms
  • Optimize database performance, query execution, and storage strategies.
  • Support data migration, modernization, and integration initiatives.

Required Skills & Experience

Technical Skills

  • 4 years of experience designing, building, and maintaining data platforms and solutions.
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
  • Experience with technologies like:
    • Databricks
    • Snowflake
    • Azure Synapse Analytics
    • Microsoft SQL Server
    • PostgreSQL
    • SQL development and optimization
  • Experience developing ETL/ELT pipelines and integrating data from multiple sources.
  • Strong understanding of data modelling, data warehousing, and lakehouse architectures.
  • Experience implementing data quality, validation, cleansing, and reconciliation processes.
  • Knowledge of cloud-based data platforms and modern data engineering practices.
  • Familiarity with CI/CD, DevOps, automation, and infrastructure-as-code principles is desirable.
  • Self-motivated and capable of working independently with minimal supervision.
  • Proven ability to support client initiatives and deliver business outcomes.
  • Comfortable working across diverse technologies and adapting to changing technical environments.
  • Positive, collaborative, and solutions-focused attitude.

AllRecruits

About AllRecruits

AllRecruits is designed for today's market where over 2.5 million Kiwis are on LinkedIn and over 70% of open roles are now filled by what is known as the "Passive Candidate". Their CV's are not posted, they do not look at job ads, so these candidates only respond to direct messaging from people in their network.

Our recruitment consultants, with their national and international networks, have the time and the motivation to find these candidates, present them with the role, and screen them for the right fit.

We are structured so that the majority of the profits go directly to our consultants, allowing them to create a personalised business within a business. With more skin in the game, our consultants offer our clients and candidates:

More Time

• To advise candidates on job searches

• To perform extensive searches for the right candidates

• To qualify candidates and jobs more thoroughly

Better Commitment

• To work on fewer roles, giving each the priority level it deserves

• To maintain continuity and personalised service

• To develop long-term extensive networks in our specialized areas

Higher Integrity

• To be honest about what we can deliver, as all our decisions have a personal impact

• To do what is right, as we value quality services over overall company revenue

Greater Flexibility

• To alter our strategies and procedures to better meet client needs

• To maintain a healthy job/life balance, which keeps us fresh and motivated

The AllRecruits structure creates a passion and a purpose that make for a highly functional, autonomous, happy team with the time and the motivation to provide you with a superior personalised level of service.

Specialist areas of services:

• Software Development

• Infrastructure Technology

• Technology Transformation

• Business Intelligence and Data Analytics

• Digital Marketing

• Construction

• People & Culture / Human Resources

• Operations

Industry
HR & Recruiting
Company Size
1-10 employees
Headquarters
New Zealand, NZ
Year Founded
2022
Social Media