About the role
Job Summary
Responsibilities
Requirements
Design, build, and operate reliable data pipelines and reusable data products ensuring engineering quality, and accessible throughout the lifecycle.
Responsibilities
- Design and evolve data architectures, pipelines, and data models, making explicit trade-offs between business needs, reliability, complexity, and cost.
- Build and operate data integration and transformation processes across multiple sources, including incremental loading, schema changes, and safe reprocessing.
- Deliver trusted, reusable datasets and data products that support reporting, self-service analytics, and advanced analytics use cases.
- Own the operational quality of data solutions, including monitoring, incident resolution, data quality controls, performance, and cost optimization.
- Implement security, governance, and data lifecycle requirements in collaboration with data owners and corporate IT, within agreed responsibilities.
- Evaluate and adopt technologies and automation approaches that improve data engineering quality, reliability, and efficiency.
Requirements
- Bachelors or Masters degree with 5+ years of relevant experience with strong hands-on data engineering expertise, preferably in Databricks.
- Strong SQL and Python with demonstrated experience independently designing, delivering, and operating production data pipelines and data models.
- Practical knowledge of distributed processing, storage patterns, orchestration, and their architectural trade-offs.
- Hands-on experience with automated testing, CI/CD, monitoring, and troubleshooting production failures.
- Ability to translate complex business requirements into robust technical and analytical solutions.
Requirements
- Bachelors or Masters degree with 5+ years of relevant experience with strong hands-on data engineering expertise, preferably in Databricks.
- Strong SQL and Python with demonstrated experience independently designing, delivering, and operating production data pipelines and data models.
- Practical knowledge of distributed processing, storage patterns, orchestration, and their architectural trade-offs.
- Hands-on experience with automated testing, CI/CD, monitoring, and troubleshooting production failures.