About the role
Your new company
Our client is a large, established New Zealand organisation undergoing significant investment in its cloud data capabilities. With a strong focus on modern data platforms, innovation and engineering excellence, they are looking to strengthen their technical leadership as they continue to evolve their enterprise data environment.
Your new role
An exciting opportunity has arisen for an experienced Principal and Senior Data Engineer to lead the design, development and optimisation of enterprise-scale cloud data solutions. Working across Data Platform and Data Product teams, you will provide hands-on technical expertise, influence architectural decisions and establish engineering best practices.
Responsibilities
Our client is a large, established New Zealand organisation undergoing significant investment in its cloud data capabilities. With a strong focus on modern data platforms, innovation and engineering excellence, they are looking to strengthen their technical leadership as they continue to evolve their enterprise data environment.
Your new role
An exciting opportunity has arisen for an experienced Principal and Senior Data Engineer to lead the design, development and optimisation of enterprise-scale cloud data solutions. Working across Data Platform and Data Product teams, you will provide hands-on technical expertise, influence architectural decisions and establish engineering best practices.
Responsibilities
- Lead the design, development and optimisation of cloud-native data pipelines using Azure Databricks, Python, Spark and Delta Lake.
- Provide technical leadership across data engineering and platform teams.
- Design scalable batch and streaming data processing solutions.
- Drive CI/CD, infrastructure as code, DevOps and automated deployment practices.
- Establish engineering standards across data governance, metadata management and security.
- Collaborate with architects, engineers, product owners and stakeholders to deliver enterprise data solutions.
- Contribute to platform architecture, technical strategy and roadmap development.
- Mentor engineers and promote engineering excellence across teams.
- Develop reusable platform components, technical documentation and quality assurance processes.
- Identify opportunities to improve platform performance, reliability and cost efficiency.
- Minimum 12 years' senior-level experience in data engineering, cloud platforms or data architecture.
- Extensive hands-on experience with Azure Databricks, Python, Apache Spark and Delta Lake.
- Strong experience with Azure Data Lake, Synapse, Key Vault and Event Hubs.
- Proven experience designing scalable, secure and cost-effective enterprise data platforms.
- Strong knowledge of Azure DevOps, Terraform, Git and ARM/Bicep.
- Experience implementing CI/CD pipelines and infrastructure as code.
- Experience designing batch and streaming data pipelines.
- Demonstrated technical leadership and mentoring experience.
- Excellent communication, stakeholder engagement and problem-solving skills.
- Relevant tertiary qualification or equivalent practical experience.
- Experience working in complex enterprise environments.
- Knowledge of cloud security and compliance frameworks.
- Experience with Azure Monitor, Great Expectations or similar observability tools.
- Experience working in agile, multidisciplinary teams.
- Exposure to DataOps and platform engineering practices.
- Auckland-based opportunity with remote working options.
- Lead complex, enterprise-scale cloud data engineering initiatives.
- Influence architectural decisions and long-term platform strategy.
- Work with modern Azure data technologies.
- Collaborate with experienced technical specialists and senior stakeholders.
- Opportunity to mentor engineers and establish engineering best practices.
- Work on meaningful, large-scale data transformation initiatives.