In short
Senior Data Engineer designing and building a modern cloud data platform on Databricks and Azure for a well-known New Zealand organisation. Day to day involves building scalable ETL/ELT pipelines with Python, PySpark, SQL and Azure Data Factory, plus batch and real-time processing with Delta Lake, Spark Streaming and Kafka/Event Hubs.
About the role
Jora New Zealand will close on 9th September 2026. Thank you for being with us, we are cheering you on as you continue your career journey.
Join a well-known NZ organisation investing heavily in its digital and data capability. We’re looking for an experienced Senior Data Engineer to help design, build and optimise a modern cloud-based data platform, with a strong focus on Databricks, Azure and scalable data engineering.
This is a hands-on senior role suited to someone who enjoys solving complex data problems, building robust pipelines and working across both batch and real-time data environments.
What you'll be doing
- Designing and building scalable data pipelines using Databricks and Azure Data Factory
- Developing data workflows using Python, PySpark and SQL
- Building and optimising ETL/ELT pipelines across cloud and on-premise data sources
- Working with Delta Lake, CDC and lakehouse architecture
- Developing batch and real-time data processing solutions
- Working with technologies such as Spark Structured Streaming, Event Hubs and Kafka
- Optimising Spark workloads, Databricks jobs and data storage patterns
- Designing data models for analytical and operational use cases
- Improving data quality, monitoring, governance and reliability
- Supporting CI/CD, code reviews and engineering best practice
- Mentoring other engineers and contributing to technical standards
What we're looking for
- 5+ years' experience in Data Engineering
- At least 2 years' strong hands-on Databricks experience
- Strong Python, PySpark and SQL capability
- Solid experience with Azure Data Factory
- Strong understanding of Apache Spark and Delta Lake
- Experience working with Azure Data Lake and broader Azure data services
- Experience building production-grade batch and/or streaming pipelines
- Good understanding of data modelling, data warehousing and lakehouse concepts
- Experience with Git, CI/CD and modern engineering practices
- Strong troubleshooting, performance optimisation and problem-solving skills
Experience with Unity Catalog, Kafka/Event Hubs, Docker, Infrastructure as Code, MLOps or data governance would be advantageous.
This is a great opportunity for a senior engineer who wants to work on a modern data platform in a highly visible environment where data plays an important role in the organisation's digital strategy.
#SCR-kelly-cappel