In short
Data Engineer building and maintaining scalable data pipelines and models with Databricks, Spark, Delta Lake, SQL and Python on AWS. Engages business stakeholders, designs analytical datasets, and ensures data quality for a leading Asia-Pacific organization, hired via recruitment firm nSearch Global in Singapore.
About the role
Our client, one of Asia-Pacific’s leading organizations is looking for:
Data Engineer
Responsibilities:
- Engage directly with business stakeholders to understand requirements and translate them into data models, datasets and pipelines
- Design and develop data models and transformation pipelines to integrate, clean, harmonise and curate data from multiple source systems
- Build and maintain scalable, reliable and reusable data pipelines using Databricks, Spark and SQL
- Design datasets and data structures optimised for downstream reporting, analytics and data science applications
- Implement data quality checks, validation and reconciliation to ensure data accuracy and consistency
- Monitor and troubleshoot pipeline performance and operational issues; Document data models, datasets, transformations and pipeline dependencies
Requirements:
- Degree in Computer Science, Information Technology, Data Engineering or related strong proficiency in SQL and experience with relational databases and data warehousing
- Strong experience in data modelling, including dimensional modelling and designing analytical datasets
- Proficiency in Python for data processing and pipeline development; Hands-on experience with Databricks, Apache Spark and Delta Lake
- Experience designing and developing ETL/ELT pipelines and data transformation workflows; Experience working with AWS data services and cloud-based data platforms
- Ability to engage business stakeholders, understand business processes and translate requirements into technical data solutions.
- Familiarity with Git, CI/CD and data pipeline orchestration; Familiarity with data governance, access control and data quality practices.
- Good to have experience with Databricks Workflows, Unity Catalog and Delta Lake
- Good to have experience designing data products for business intelligence and self-service analytics
-------------------------------------------------------------------------------------------------------------
Interested applicants can also email CV at harry@nsearchglobal.com (for faster processing, please state the exact job / position title applied “Data Engineer”
Only shortlisted candidates will be notified.
-------------------------------------------------------------------------------------------------------------
EA License Number: 10C3636
EA Personnel Name: Arora, Hardeep
EA Personnel Registration Number: R1111454
By submitting your resume and cover letter to apply for our job opening, you confirm that you have read the Data Protection Notice for Job Applicants (https://www.nsearchglobal.com/dp-notice/job-applicants) and you consent to the collection, use, and disclosure of your personal data for the purpose of verifying and evaluating your job application. Additionally, you have to notify and obtain consent from all individuals listed as your references to their data being collected and disclosed for the purposes related to your job application