In short
Lead a small data engineering team at an established UK digital consultancy delivering large-scale data and AI programmes for government, healthcare and enterprise clients. You stay hands-on building data pipelines at scale on Palantir Foundry, Spark and the cloud, set engineering standards, coach the team, and work directly with clients on scoping and proposals.
About the role
Location: London (2 days per month on site)
Employment Type: Permanent
Salary: Up to £95,000 + bonus
Start Date: Immediate
I'm working with a leading UK digital consultancy, 30+ years in business, delivering large-scale data and AI programmes for government, healthcare and enterprise clients.
They're one of the most established Palantir delivery partners in the UK, and they're hiring a Lead Data Engineer to grow their Data & AI practice.
- Lead a small team of engineers and own whole components end to end: design, build, test, fix
- Stay hands‑on, building data pipelines at scale on Palantir Foundry, Spark and the cloud
- Set the engineering standards and coach your team to hit them
- Work directly with clients, scope the work and help shape new proposals
- Manage and develop your own people
- Experience leading data engineers on data‑heavy systems
- Deep knowledge of Spark, Databricks or other distributed processing tools
- Solid data modelling, analytical and operational
- Able to explain technical design clearly to anyone
- Palantir Foundry is a big plus, but strong Spark leads keen to learn it will be considered
Requirements
- Experience leading data engineers on data-heavy systems
- Deep knowledge of Spark, Databricks or other distributed processing tools
- Solid data modelling, analytical and operational skills
- Able to explain technical design clearly to anyone
Nice to have
- Palantir Foundry experience (strong Spark leads keen to learn it will be considered)