In short
Compare the Market Australia is hiring a Data Engineer to design, build and maintain scalable cloud data solutions on Databricks. Day to day: delivering robust data pipelines, lakehouse architectures and curated data assets that support reporting, analytics and AI/ML, while keeping the platform governed, optimised and reliable.
About the role
Compare the Market Australia is seeking a Data Engineer to design, build and maintain scalable cloud data solutions using Databricks and related platforms, delivering robust data pipelines, lakehouse architectures and curated data assets to support reporting, analytics and AI/ML initiatives.
You will work with stakeholders, analysts, data scientists and engineers to transform raw data into trusted, accessible information while ensuring the platform remains governed, optimised and reliable.
Requirements
- Design, build and maintain scalable cloud data solutions using Databricks
- Deliver robust data pipelines and lakehouse architectures
- Build curated data assets for reporting, analytics and AI/ML initiatives
- Keep the data platform governed, optimised and reliable
- Collaborate with stakeholders, analysts, data scientists and engineers to transform raw data into trusted, accessible information