In short
ConnectOS is hiring a data engineer in Mandaluyong (Manila) to design, build, and support scalable data pipelines using Apache Spark and Databricks, working with Parquet and Delta Tables, Unity Catalog governance, and Azure data services (ADF, ADLS, Synapse) on a Monday–Friday onsite schedule.
About the role
ConnectOS is seeking a data engineer to design, develop, and support scalable data pipelines using Apache Spark and Databricks. You will manage data in Parquet and Delta Tables, participate in governance with Unity Catalog, and collaborate on data models with senior engineers.
You should be proficient in Python and familiar with Azure data services (ADF, ADLS, Synapse). The role emphasizes cloud fundamentals, security, and scalable architectures within a Monday–Friday schedule in Manila.
Requirements
- Proficiency in Python
- Design, develop, and support scalable data pipelines using Apache Spark
- Experience with Databricks
- Experience managing data in Parquet and Delta Tables
- Familiarity with Azure data services (ADF, ADLS, Synapse)
- Cloud fundamentals
- Understanding of security best practices
Nice to have
- Experience with data governance (Unity Catalog)
- Ability to collaborate on data models with senior engineers