Compare the Market

AI Data Engineer

Compare the Market  •  Brisbane, AU (Onsite)  •  11 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Who We Are

iSelect and Compare the Market are trusted, well-known brands dedicated to helping millions of Australians compare and buy personal finance and household products such as insurance, energy, and loans. Together, we provide a seamless, customer-focused experience that makes it easier for Australians to find the right products to suit their needs.

What You’ll Be Doing

As an AI Data Engineer, you'll play a key role in advancing iCompare's modern data and AI platform, helping the business safely and effectively adopt AI-enabled capabilities. This is a unique opportunity to combine data engineering expertise with emerging AI technologies, delivering solutions that create real business value.

You will:

  • Design, build and optimise scalable data pipelines and AI-ready data products across batch, streaming and event-driven architectures.
  • Develop production-grade retrieval pipelines, supporting document ingestion, embeddings, vector search, semantic retrieval and Retrieval Augmented Generation (RAG) solutions.
  • Establish reusable patterns for AI enablement across prompt orchestration, model integration, evaluation workflows and model-ready datasets.
  • Apply DataOps and MLOps practices to support deployment, monitoring, testing, observability and continuous improvement.
  • Champion responsible AI, governance and secure-by-design engineering practices, ensuring solutions are reliable, scalable and compliant.
  • Collaborate closely with data engineers, AI engineers, architects, software engineers and business stakeholders to deliver innovative data and AI capabilities.

What’s In It For You

At Compare the Market and iSelect, we’re all about helping people make smart choices – and joining us might just be yours. We offer an environment where your ideas are heard, your contributions are valued, and your growth genuinely matters. Collaboration is part of our DNA and you’ll be joining a supportive, forward-thinking team where you can do meaningful work (and be recognised for it!)

We’re guided by three shared values that shape how we work, how we treat each other, and how we show up for our customers - Drive, Noble Intent and All Together.

Plus, we offer a range of great perks to help you thrive both in and out of work:

  • Vibrant and social community who have annual celebrations, family fun days and regular events
  • Enjoy flexible work arrangements, including the option of one day working from home each week or a 9-day fortnight
  • Enjoy additional leave days - ‘ME’ leave and ‘Volunteer Day’ leave
  • Option to purchase additional leave
  • Return To Work bonus for returning parents
  • Quarterly Award and Recognition program

What Sets You Apart

You'll bring a blend of strong data engineering capability and a passion for emerging AI technologies, with experience building scalable cloud-based data solutions and enabling AI-driven use cases.

You'll ideally have:

  • Experience in Data Engineering, Analytics Engineering, Machine Learning Engineering or AI Engineering.
  • Strong hands-on experience with Databricks, Spark, PySpark, Python and SQL.
  • Experience designing and building data products that support AI and machine learning use cases.
  • Knowledge of generative AI concepts including RAG, embeddings, vector search, prompt orchestration and LLM applications.
  • Experience applying software engineering best practices including CI/CD, testing, infrastructure as code and version control.
  • An understanding of DataOps, MLOps, governance, security and responsible AI practices.
  • Excellent communication skills and the ability to engage with both technical and non-technical stakeholders.
  • Experience building AI-enabled applications, intelligent search solutions, copilots or agentic workflows will be highly regarded.

Who We Are

iSelect and Compare the Market are trusted, well-known brands dedicated to helping millions of Australians compare and buy personal finance and household products such as insurance, energy, and loans. Together, we provide a seamless, customer-focused experience that makes it easier for Australians to find the right products to suit their needs.

Interested? Let’s chat!

At Compare the Market and iSelect we’re proud to be an Equal Opportunity Employer and we embrace diversity.

This role is available to candidates with unlimited Australian working rights only. Sponsorship is not available.

iSelect and Compare the Market, brands of iCompare Group, are committed to protecting your privacy. All applications and personal information are kept confidential and securely stored in line with Australian privacy laws, used only for recruitment purposes, and not shared with third parties outside iCompare Group without your consent.

Compare the Market

About Compare the Market

Compare the Market is one of the UK's best loved and most recognised brands.

Our purpose is to make great financial decision-making a breeze for everyone; simple for the perplexed, quick for the hassled, funny for the bored, and confident for the nervous and unsure.

We think good things happen for our customers when they meerkat, but we also think this is true for our colleagues.

We believe in looking after our people and developing talent. We think that making life enjoyable in and out of work helps us to be the best we can be. We therefore give our people all kinds of extra benefits, whether that’s professional training, healthcare or life insurance, family fun days, monthly prize draws and a whole lot more.

To find out more about working at Compare the Market and to see our open jobs, visit joinus.comparethemarket.com .

Don’t forget to follow us on twitter: @comparemkttech

Industry
IT & Software
Company Size
501-1,000 employees
Headquarters
London, GB
Year Founded
Unknown
Social Media