About the role
Blue Data Digital SDN BHD in Kuala Lumpur is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and platforms. You will own end-to-end data flows, from ingestion to modeling and delivery, enabling analytics, BI, and AI/ML initiatives across the organization.
The ideal candidate has hands-on Python and SQL expertise, strong data modeling knowledge, and the ability to architect solutions on cloud platforms (GCP preferred).
Design, build, and maintain scalable batch and real-time data pipelines using ETL/ELT patterns. Ingest and integrate structured, semi-structured, and unstructured data from diverse sources. Implement incremental loading, CDC, and idempotent pipeline design. Design and optimize data models for analytics and reporting. Build and manage data warehouses and lakehouses (BigQuery, Cloud Storage). Orchestrate workflows using Cloud Composer, Dagster, Prefect, or similar tools. Implement data validation and quality checks (Great Expectations, dbt tests, Soda, Dataplex). Monitor, troubleshoot, and optimize pipelines for performance and cost. Collaborate with analytics, BI, AI/ML, and software teams to meet business needs. Bachelor's degree in a relevant field (CS/IT/Data Science). Strong Python and SQL skills with hands-on data engineering experience. Experience building batch and real-time data pipelines. Familiarity with data warehousing concepts and data modeling.