In short
Senior data engineer (9-14 yrs) in Sydney building enterprise-scale data platforms on AWS: designing batch and real-time ingestion, optimizing pipelines, and delivering low-latency streaming with Kinesis/Kafka. Core stack: AWS, Python, PySpark, databases, CI/CD and IaC.
About the role
The Hr Ally is seeking an experienced Data Engineer (9-14 years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS in Sydney.
You will design scalable batch and real-time data ingestion, optimize pipelines, and build low-latency streaming solutions using Kinesis or Kafka. The role demands strong AWS, Python, PySpark, and database expertise, with CI/CD and IaC know-how.
Requirements
- 9-14 years of experience as a Data Engineer
- Design scalable batch and real-time data ingestion
- Optimize data pipelines
- Build low-latency streaming solutions using Kinesis or Kafka
- Strong AWS expertise
- Strong Python skills
- PySpark expertise
- Database expertise
- CI/CD know-how
- Infrastructure-as-Code (IaC) know-how