About the role
CandidHR in Australia seeks a data engineer expert in Databricks and Fabric for a fully remote role. You will design, build and maintain scalable data pipelines and data solutions that drive business insights and decision-making, working closely with data scientists and analysts.
The role emphasizes data quality, performance optimization at scale, and documentation of processes. You will mentor junior engineers and collaborate across cloud platforms such as Azure and AWS in a distributed team.
Design, develop, and maintain scalable data pipelines using Databricks and Fabric. Implement data transformations to ensure data quality and integrity. Collaborate with data scientists and analysts to understand data needs and deliver reliable data solutions. Optimize data storage and processing performance for large datasets. Monitor and troubleshoot data pipeline performance ensuring minimal downtime. Document data engineering processes and best practices. Mentor junior data engineers and promote knowledge sharing within the team. Bachelor's degree in Computer Science, Engineering, or related field. 5+ years in data engineering focusing on Databricks and Fabric. Strong SQL, Python, and Spark skills. Experience with data modeling and ETL best practices. Familiarity with cloud data platforms (Azure, AWS). Ability to work independently and in a remote team.