In short
Design, build and maintain data pipelines for ingestion, integration, transformation and storage across cloud and enterprise data platforms, working with SQL, Python, ETL frameworks, orchestration and data governance practices. On-site role in Singapore supporting data lakes, warehouses and downstream analytics.
About the role
Key Responsibilities:
- Design, develop and maintain data pipelines for data ingestion, integration, transformation, storage and processing across cloud and enterprise data platforms.
- Integrate data from multiple sources, including databases, APIs, files, streaming sources, IoT and OT systems.
- Develop and maintain data processing workflows to support enterprise data requirements and downstream analytics use cases.
- Implement data validation, quality checks, monitoring and error-handling mechanisms to ensure data accuracy and reliability.
- Work with SQL, Python or equivalent programming languages, ETL frameworks and data orchestration tools to develop and maintain data engineering solutions.
- Support the development and maintenance of data lakes, data warehouses and data models.
- Apply version control and relevant data engineering practices to ensure maintainable and reliable data solutions.
- Support data governance activities, including metadata management, data lineage, access control and data lifecycle management.
- Collaborate with senior data engineers, software engineers, cloud engineers and other technical stakeholders to support data platform implementation and maintenance.
Requirements:
- At least TWO (2) years of experience as a Data Engineer or in a similar data engineering role, including the design, development and implementation of data pipelines, data ingestion and integration workflows, data transformation, data storage and data processing solutions on cloud and/or enterprise data platforms.
- Experience in integrating data from multiple sources, including structured and unstructured data, APIs, databases, files, streaming sources and/or IoT or OT systems, and implementing appropriate data quality, validation, monitoring and error-handling mechanisms.
- Experience with relevant data engineering technologies and practices, including SQL, Python or equivalent programming languages, ETL frameworks, data lakes and/or data warehouses, data modelling, orchestration and version control.
- Experience in implementing data governance, metadata management, data lineage, access control and/or data lifecycle management requirements within enterprise data environments.