About the role
UNISYNC SYSTEMS PTE. LTD. is seeking an experienced Data Engineer to design and operate scalable data pipelines within an enterprise Data Lake, leveraging Cloudera CDP, Hadoop, Spark, Hive, Java, Python, and SQL.
The role focuses on batch and near real-time ingestion to onboard diverse enterprise sources into the Lake. You will drive data quality and governance while collaborating with platform teams to optimize cluster utilization.
Design, develop and maintain scalable data pipelines in Enterprise Data Lake using Cloudera CDP/Hadoop/Spark/Hive/SQL. Develop high-performance batch and real-time data ingestion for onboarding source systems. Implement data transformations using Spark, HiveQL, SQL and Java-based processing. Design and implement ingestion patterns for structured, semi-structured and unstructured data. Build and maintain batch/near real-time data integration solutions. Define source-to-target mappings and ingestion specs. 10+ years of experience in data engineering or related field. 5+ years managing Enterprise Data Lake/ DW or Big Data programs. Experience in Hadoop/Cloudera environments is required. Banking/Financial Services experience preferred.