In short
Data Engineer in SSE's Data & AI team, building and optimising data ingestion, transformation and serving layers using Azure Databricks, Delta Lake and Databricks SQL. Delivers ELT/ETL pipelines and BI data models for the Renewables Data Platform, including migration of solutions from Synapse.
About the role
SSE is seeking a Data Engineer to design, build, and optimise data ingestion, transformation and serving layers using Azure Databricks, Delta Lake and Databricks SQL. You will collaborate with data architects, analysts and product teams to deliver robust ELT/ETL pipelines and model data for BI and analytics.
You will work within the Data & AI team, contributing to our Renewables Data Platform and migrating solutions from Synapse, with hands-on pipeline development, data modelling and governance
Requirements
- Design, build and optimise data ingestion, transformation and serving layers with Azure Databricks, Delta Lake and Databricks SQL
- Experience delivering robust ELT/ETL pipelines
- Data modelling for BI and analytics
- Hands-on data governance experience
- Collaborate with data architects, analysts and product teams
Nice to have
- Experience with Azure Synapse (migrating solutions from Synapse)