About the role
Data Engineer | London | Hybrid/Flexible working | Salary up to £106,000
An international bank's EMEA capital markets and corporate banking business is building a new data platform from scratch on Azure, with some components in its on-prem data centre, and migrating legacy capability onto it. They need a hands-on Data Platform Data Engineer to join a fast-growing team and design, build and run the pipelines that will power data across the business.
The role:
- Design and build scalable data pipelines, ETL processes and integrations on Azure and Databricks.
- Turn business and data requirements into pipeline and platform designs, then implement them.
- Bring data in from databases, APIs and streaming sources into central repositories and warehouses.
- Build data models and transformation logic, with validation, profiling and error handling to keep data trustworthy.
- Tune SQL and Spark workloads to fix bottlenecks and handle growing volumes.
- Own your solutions end to end, including CI/CD pipelines and automated testing.
- Apply data governance, access controls and encryption with security and compliance teams.
- Monitor pipelines and platform health, and keep clear documentation.
- Mentor colleagues through code reviews, peer review and knowledge sharing.
Essential:
- Extensive experience as a data engineer or analyst developer in a data-centric environment.
- Strong hands-on Azure data experience, including Databricks.
Strong SQL and relational database skills (Oracle or MS SQL), plus Python and PySpark.
- Proven delivery of end-to-end data solutions, from ingestion to consumption.
- DevOps experience: CI/CD, Git and GitHub.
- Knowledge of data architectures such as data lakes, lakehouses, hub and spoke and data fabrics.
- Experience integrating data through APIs, JSON, XML or message bus technology. C# is useful.
- Experience in capital markets, corporate banking or asset management.
- Docker and Kubernetes.
- Data virtualisation tools such as Denodo or Snowflake.
- Agile working and Atlassian tools.
What you get:
- Salary dependent on experience + discretionary bonus
- Hybrid and flexible working.
- Pension, private medical insurance, and life and invalidity cover.
- Learning and development support and clear routes for progression.
- A greenfield build, a growing team and the chance to shape how the platform is built.