In short
Senior Data Engineer at XPT Software in Canberra designing, building, and optimizing scalable Azure Databricks lakehouse solutions. Day to day: implementing batch and streaming pipelines, integrating with ADLS Gen2, Data Factory and Key Vault, and delivering production notebooks, jobs and CI/CD workflows with data governance and cost efficiency.
About the role
XPT Software in Canberra, ACT, is seeking a Senior Data Engineer with strong hands-on experience in Azure Databricks to design, build, and optimize scalable data pipelines and lakehouse solutions for analytics and decision-making.
You will implement batch and streaming pipelines, integrate with Azure Data Lake Storage Gen2, Data Factory, and Key Vault, and deliver production-grade notebooks, jobs, and CI/CD workflows while enforcing data governance and cost efficiency.
Requirements
- Strong hands-on experience in Azure Databricks
- Design, build and optimize scalable data pipelines and lakehouse solutions
- Implement batch and streaming pipelines
- Integrate with Azure Data Lake Storage Gen2
- Integrate with Azure Data Factory
- Integrate with Azure Key Vault
- Deliver production-grade notebooks, jobs and CI/CD workflows
- Enforce data governance and cost efficiency