In short
Freelance/contract Data Engineer in Madrid building and optimizing large-scale data pipelines on Microsoft Azure (Data Factory, Databricks, PySpark, ADLS, SQL, Python) to deliver high-quality data to Collective.work's AI-powered recruitment platform for AI agents and product features.
About the role
Collective.work is building the next generation of AI-powered recruitment. The company supports over 20,000 recruiters and headhunters across France, Belgium, Spain, and EMEA, and is expanding its product and distribution in the UK. Their platform combines a suite of AI agents — from sourcing and outreach to job posting and ATS integrations — with a database of 800M+ professional profiles and a network of 1M+ active candidates.
Missions- Design, build, and maintain scalable data pipelines for large-scale data ingestion, transformation, and enrichment.
- Develop and optimise data infrastructure within the Microsoft Azure ecosystem.
- Improve data quality, reliability, and processing performance.
- Make high-quality data accessible to AI agents and product features. xqbhyrx
- Collaborate with engineering and product teams to deliver robust, production-ready solutions.
- Microsoft Azure data services
- Azure Data Factory
- Databricks
- PySpark
- Azure Data Lake Storage
- SQL
- Python
- Location: Madrid, Spain
- Type: Freelance / Contract
- Start date: ASAP
- Duration and day rate: To be agreed
Requirements
- Design, build, and maintain scalable data pipelines for large-scale ingestion, transformation, and enrichment
- Experience developing and optimizing data infrastructure within the Microsoft Azure ecosystem
- Azure Data Factory
- Databricks
- PySpark
- Azure Data Lake Storage