About the role
TOPPAN ECQUARIA PTE. LTD. is seeking a data engineering professional to design, build and maintain large-scale batch and real-time data pipelines in Singapore.
You will ingest, clean and transform data using Spark and big data frameworks, and design data tables in data lakes and data warehouses to support analytics. Responsibilities include developing backend APIs and integrating databases to support applications, collaborating with Agile teams, and ensuring data governance and security best
Design, build and maintain efficient and reliable large-scale batch and real-time data pipelines. Ingest, clean, transform data to ensure pipelines are efficient, reliable and scalable. Design, develop and deploy data tables in data lake/data warehouses. Design and develop backend APIs and database integrations to support applications/use cases. Degree or Diploma in CS/CE/IT/Business Analytics or related. 2–8 years' experience designing, developing or maintaining data platforms. Led a team of data engineers. Experience with Spark, Scala or PySpark. Experience with Hadoop, Azure Data Factory, Azure Synapse. Data modeling/design and management (Data Mart, Data Lake, Data Warehousing). Experience building production-grade data pipelines using cloud platforms such as Azure. Experience with Agile teams. Knowledge of data governance, access control and security best practices. Stakeholder engagement/requirements analysis.