In short
EPAM Systems in Wrocław is hiring a Senior Data Platform Engineer to build a scalable, ML-ready data platform migrating to Azure-native Databricks. Day to day involves developing PySpark ETL/ELT pipelines, tuning ML models in Azure, and enhancing data governance, quality, and security while incorporating GenAI capabilities.
About the role
EPAM Systems in Wroclaw is seeking a Senior/Lead Data Software Engineer to drive a scalable, ML-ready platform, migrating to Azure-native Databricks and enhancing data governance for compliant data workflows.
You will optimize data processing, tune ML models in Azure, and develop robust PySpark ETL/ELT pipelines while collaborating across teams to incorporate GenAI capabilities and ensure data quality and security.
Requirements
- Senior/Lead-level data software engineering experience
- Experience with Azure-native Databricks
- Development of robust PySpark ETL/ELT pipelines
- Data processing optimization
- Tuning ML models in Azure
- Data governance for compliant data workflows
- Ensuring data quality and security
Nice to have
- Collaborating across teams to incorporate GenAI capabilities