In short
Azure Data Engineer at Scicom MSC Berhad in Kuala Lumpur, optimizing enterprise cloud data operations: managing Databricks clusters, building ETL/ELT pipelines, and ensuring data lake/warehouse health via monitoring with Azure Monitor, Log Analytics, and Datadog. Salary RM8k-10k.
About the role
Scicom MSC Berhad is seeking an Azure Data Engineer to optimize enterprise cloud data operations focused on Microsoft Azure, Databricks cluster management, and robust ETL/ELT pipelines. The role emphasizes health and performance of data lakes and warehouses with comprehensive monitoring and logging strategies.
You will oversee Databricks management, develop data workflows, and implement monitoring using Azure Monitor, Log Analytics, and Datadog to proactively resolve bottlenecks and ensure data
Requirements
- Microsoft Azure cloud data operations
- Databricks cluster management
- ETL/ELT pipeline development
- Data lake and data warehouse management
- Monitoring and logging with Azure Monitor and Log Analytics
- Monitoring with Datadog