About the role
About Cressoft
Cressoft is a UK-based IT consultancy, operating since 2011 and delivering elite technical talent to global brands. We’re proud to be the exclusive offshore partner supporting a major engineering-led digital transformation for one of the UK’s largest supermarket chains.
Overview
As a Senior Engineer, you will design and implement backend and data solutions using Snowflake, Python, AWS, Airflow, and dbt. You will contribute to architectural decisions, mentor engineers, and collaborate with multiple teams to deliver reliable, high‑performance systems at scale.
Key Responsibilities
- Define technical solutions aligned with CDP engineering standards and Sainsbury’s Engineering principles.
- Design, build, test, and deploy services and enhancements into production with a strong focus on quality, performance, and reliability.
- Refine technical user stories, produce detailed Jira tickets, and ensure requirements are clearly understood by the team.
- Produce and present product level Key Design Decision (KDD) documents to Design Authority for architectural alignment.
- Build, design, and support large‑scale real‑time and batch data pipelines processing millions of records.
- Implement integrations with internal and third‑party APIs and event-driven systems.
- Maintain strong test discipline across unit, integration, and end‑to‑end testing.
- Mentor and upskill engineers across Python, data workflows, tooling, and engineering best practices.
- Promote observability and reliability through tools such as New Relic.
- Continuously improve engineering practices, tooling, documentation, and delivery processes.
Ways of Working
Communicates clearly with both technical and non‑technical stakeholders.
Works collaboratively with technology, data and marketing teams.
Operates effectively within Scrum Agile practices and contributes positively to team
ceremonies.
Displays empathy, supports colleagues, and contributes to a positive team culture.
Self‑driven, pragmatic, and comfortable taking ownership of tasks and delivery.
Advocates for agile/lean delivery, continuous improvement, and high-quality engineering.
Technical Expertise
Required
- Strong Python development skills and ability to guide others.
- Advanced SQL skills and experience working with large-scale datasets.
- Deep experience with Snowflake (data modelling, optimisation, performance).
- Solid understanding of engineering and architectural principles, microservices design, and data-centric systems.
- Airflow experience (designing, orchestrating, monitoring workflows).
- dbt experience (data modelling, transformations, testing).
- Experience building and operating both real-time and batch data pipelines.
- Hands-on experience with AWS (S3 and core cloud services).
- Strong CI/CD experience with GitHub Actions and or similar technology.
- Proficient with Git/GitHub and collaborative development workflows.
- Experience using Terraform and Infrastructure as Code.
- Strong automated testing practices across unit, linting, integration, and end-to-end tests.
- Experience working with structured, semi-structured, and unstructured data.
- Experience with observability and monitoring tools such as New Relic or similar Technology.
Desirable
- Familiarity with Customer Data Platforms (CDP) and customer data ecosystems.
- Experience with Kubernetes and Docker.
- Experience with AWS Lambda.
- Exposure to Kafka or similar, though not essential.
Technology Stack
- Programming: Python, SQL
- Data Warehouse: Snowflake
- Cloud: AWS
- Orchestration: Airflow
- Data Transformation: dbt
- CI/CD: GitHub Actions
- Version Control: Git / GitHub
- Infrastructure as Code: Terraform
- Workflow and pipelines: Real-time and batch pipelines, API integrations, event-driven systems