In short
Senior data engineer building and operating scalable ingestion and processing pipelines using Databricks, Kafka, and PySpark to support AI and analytics initiatives for a major telecommunications group.
About the role
Singtel is hiring a data engineering professional to design, build, and operate scalable data ingestion and processing pipelines across a modern cloud data platform. You will work with Databricks, Kafka, PySpark, and Delta Lake to deliver reliable data for analytics and ML use cases.
You will own production readiness, collaborate with cross-functional teams, and contribute to automation and governance. This role offers growth in a dynamic AI-driven data ecosystem.
Requirements
- Design, build, and operate scalable data ingestion and processing pipelines
- Experience with Databricks
- Experience with Kafka
- Experience with PySpark
- Experience with Delta Lake
- Production readiness and automation
- Data governance