About the role
Senior Data Engineer
Microsoft Fabric | Python | PySpark | SQL | Azure
London or Birmingham | Hybrid, team days twice a month
£65,000–£75,000 + 10% bonus + 7% pension + 40 days annual holiday + private medical
Plenty of engineers can show you what they built in Microsoft Fabric. Fewer can tell you what happened over the following year: what broke, what they changed and how it held up as the data and the business grew.
That second story is the one this role is about.
A UK wealth management business needs a Senior Data Engineer to join its small Azure data team. The work combines evolving an established platform with greenfield development, so you’ll build new things and stay with them long enough to make them genuinely good. The business is also adopting AI, with Copilot and Microsoft Azure AI Foundry already in use.
It’s a purely technical role with no line management. You’ll lead technically on your own work, mentor the team’s Data Engineer, and work alongside the Data Engineering Manager, Data Product Manager, Enterprise Architect and Reporting Engineer.
The work
- Designing and building pipelines, data models and integrations across Lakehouse, Warehouse, OneLake, pipelines and notebooks, on a medallion architecture
- Python, PySpark and advanced SQL, day to day
- Connecting internal and third-party systems through APIs and SFTP
- Automated testing, validation and data quality controls
- Tuning performance, reliability and cloud cost
- Taking production incidents through to root cause and a lasting fix
- Improving observability, resilience and maintainability across the platform
- Git, Azure DevOps, CI/CD and code review, working in two-week Scrum sprints
- Documenting designs and controls to the governance, privacy and security standards a regulated business needs
What you’ll bring
- Hands-on Microsoft Fabric experience in your current or most recent role. This is essential.
- Ideally a year or more in that role, supporting and evolving what you built after go-live
- Strong Python/PySpark and advanced SQL, with solid data modelling, ETL/ELT, orchestration and data quality experience
- A working understanding of data governance, privacy and security, and how to evidence controls in what you build
- Experience mentoring or giving technical guidance to other data engineers
- Clear communication with technical and non-technical colleagues, and the self-motivation to own outcomes
- A working familiarity with AI tools such as Copilot or Azure AI Foundry. Everyone in the business is expected to have a basic level of AI competence.
- Financial services, wealth management or other regulated-sector experience is a real advantage
The practicalities
- London is the preferred base, with Birmingham also available. You’ll need to live within about an hour of either office.
- The team currently works together in the London or Birmingham office two days a month.
- Company policy is that everyone must be willing and able to work from the office up to three days a week if required, so that needs to work for you too.
- You’ll need the right to work in the UK. Sponsorship isn’t available.
The package
£65,000–£75,000 basic, 10% annual bonus, 40 days holiday (including bank holidays), 7% employer pension, private medical insurance and income protection.
If the last year or two of your work sounds like this, apply with your CV or message me for a confidential conversation. I’ll give you the full picture on the business, the team and the platform before anything goes further.