About the role
Upgrowth HR. SDN BHD is seeking a skilled Data Engineer to design, build, and maintain scalable ETL/ELT pipelines for automated data ingestion, transformation, and validation in a growing data practice.
You will centralize data storage, start with lightweight solutions and scale toward cloud-based infrastructure; collaborate with analysts and business teams to model data, implement quality checks, and refactor workflows into production-ready codebases while promoting best practices in version
Design, build, and maintain ETL/ELT pipelines for automated data ingestion, transformation, and validation. Establish a centralized data storage system, starting with lightweight solutions and scaling toward cloud-based infrastructure. Collaborate with analysts and business teams to translate reporting needs into scalable, reusable data models. Implement data quality checks, logging, and monitoring to ensure reliability and transparency of data flows. Refactor existing Python/Jupyter workflows into structured, production-ready codebases. Evaluate and recommend tools for data warehousing, orchestration, and cloud migration. Define and promote best practices in version control, documentation, and reproducibility. Proficient in Python data processing (pandas, PySpark preferred). Strong SQL skills and relational database experience. Experience building ETL/ELT pipelines and workflow orchestration (Airflow/Prefect/Luigi). Data modeling, schema design, and data governance fundamentals. Ability to work with stakeholders and translate reporting needs into data solutions.