About the role
Jbsfamily is expanding its Data Engineering team in Malaysia. We seek a Senior Data Engineer specializing in Databricks and Snowflake to build scalable lakehouse data platforms for global clients.
You will work with DevOps, Cloud Engineering and Data Scientists in Agile sprints to deliver data solutions across APAC. You will build pipelines with Azure Databricks and PySpark, design data ingestion workflows with Azure Data Factory, and define storage schemas to support AI analytics workloads.
Build and maintain scalable data pipelines using Databricks and PySpark Design and manage data ingestion and orchestration workflows using Azure Data Factory Define how data is stored, organized, and accessed Design schemas to support AI analytics workloads Build real-time analytics platforms, ML-ready data environments, and large-scale reporting Establish best practices for data quality, governance and security within Databricks Mentor junior data engineers and evolve the team's Databricks expertise Drive data architecture and modeling strategy for AI projects Implement data anonymization, quality checks, lineage and controls Ensure timely delivery of data components aligned with milestones 6+ years hands-on experience with Databricks on Azure/AWS/GCP, including Spark/ PySpark Proficiency in Python/Scala with CI/CD pipelines Experience in ETL/ELT design and implementation Familiar with Hadoop and Kafka in big data environments Passion for building scalable and reliable data systems