About the role
Datamatics Global Services Ltd in the UAE is seeking a Data Engineer to build and operate data pipelines moving data from source systems into the lakehouse, enabling analytics and AI consumers while ensuring automation, performance, security and governance. You will work with Azure Fabric and Purview to capture metadata and lineage for compliant data delivery.
The role collaborates with data architects, data quality engineers and analysts to deliver production-grade pipelines, leveraging
Build batch, incremental, CDC and streaming ingestion pipelines into Bronze layer using ADF and Fabric. Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks. Implement dimensional models, SCDs and surrogate keys. Integrate DQ checks and validation with Senior Data Quality Engineer. Publish metadata and lineage to Microsoft Purview. Ensure scheduling, dependencies, parameterization, error handling and alerts. Optimize pipelines for performance and cost using Delta/Parquet formats. Apply access controls, masking and encryption per UAE PDPL and related laws. Maintain code in source control and deploy via CI/CD with tests. Support production operations and handover runbooks. Coach counterparts so pipelines can be sustained after handover. 4+ years in data engineering, UAE government or regulated sectors. Advanced SQL, Python and PySpark/Spark skills. Hands-on with Azure Data Factory, Microsoft Fabric, Databricks or Synapse. Strong dimensional modelling and SCDs. CI/CD and DataOps familiarity. Familiarity with Microsoft Purview metadata and lineage. Excellent English communication and documentation.