About the role
PENTAS FLORA is seeking a Data Engineer to manage and modernise its enterprise data integration and data warehouse environment. You will develop pipelines to extract data from Core System and other business systems, transform and validate it with Python and ETL tools, and load into Microsoft SQL Server for reporting and analytics.
The role requires a Bachelor's degree and at least 3 years of hands-on experience in data engineering, ETL or data warehousing, with strong SQL Server, Python, and
Develop and maintain Python-based ETL pipelines to extract, transform, validate and load data from Core System and other business systems. Implement full and incremental data-loading processes with error handling, logging, reconciliation and recovery mechanisms. Monitor scheduled pipelines, troubleshoot issues and ensure reliable data processing. Design and maintain a Microsoft SQL Server-based data warehouse using dimensional modelling, fact and dimension tables, star schemas and historical data management. Support layered architecture based on Medallion Architecture, or equivalent Raw, Staging, Curated and Business-ready layers. Develop and optimise T-SQL queries, views and stored procedures to support efficient data processing. Implement data quality controls covering completeness, accuracy, duplicates and source-to-target reconciliation. Maintain data dictionaries, data mappings, business rules, data lineage and technical documentation. Provide reliable and business-ready datasets for Microsoft Power BI and enterprise reporting. Assess the existing Python ETL environment and identify opportunities to improve reliability, scalability and maintainability. Bachelor's degree in computer science, IT, data engineering or a related discipline. Minimum 3 years of hands-on data engineering, ETL or data warehousing experience. Strong practical experience with Microsoft SQL Server, T-SQL and Python-based data processing. Strong Python capability for production data extraction, transformation and loading. Good understanding of dimensional modelling, ETL pipelines, incremental loading and data quality controls. Experience with incremental loading, data validation, exception handling and reconciliation. Understanding of layered data architecture such as Medallion Architecture or an equivalent approach.