In short
Freelance, on-site Data Engineer in London designing, building and maintaining scalable data pipelines for large-scale ingestion and enrichment in the Azure ecosystem. Core stack: Azure Data Factory, Databricks, PySpark, Azure Data Lake Storage, plus strong SQL and Python. Day rate to be agreed; ASAP start.
About the role
Collective.work is seeking a freelance Data Engineer in London to design, build and maintain scalable data pipelines for large-scale ingestion and enrichment. You will develop and optimise data infrastructure within the Azure ecosystem, improving data quality and performance.
The role requires hands-on experience with Azure Data Factory, Databricks, PySpark, and Azure Data Lake Storage, plus strong SQL and Python skills. Start date ASAP; day rate to be agreed, on-site in London.
Requirements
- Design, build and maintain scalable data pipelines for large-scale ingestion and enrichment
- Hands-on experience with Azure Data Factory
- Hands-on experience with Databricks
- Hands-on experience with PySpark
- Hands-on experience with Azure Data Lake Storage
- Strong SQL skills
- Strong Python skills