About the role
Job Title: Data Engineer Databricks / Pyspark, ETL
Location: Remote
About The Role
We are seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Databricks, PySpark, and SQL. The ideal candidate will have strong expertise in ETL/ELT development, large-scale data processing, Delta Lake, and cloud-based data engineering solutions.
What You Ll Do
Location: Remote
About The Role
We are seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Databricks, PySpark, and SQL. The ideal candidate will have strong expertise in ETL/ELT development, large-scale data processing, Delta Lake, and cloud-based data engineering solutions.
What You Ll Do
- Design, build, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, and SQL.
- Develop data ingestion and transformation frameworks supporting large-volume structured and semi-structured datasets.
- Implement Delta Lake patterns, data-quality validations, exception handling, and reconciliation processes.
- Optimize Spark workloads and SQL queries for performance and cost efficiency.
- Work with Unity Catalog to manage data governance, access controls, and data organization.
- Build and manage data workflows using Databricks Workflows and Azure Data Factory (ADF).
- Implement CI/CD practices for data pipeline development, deployment, and maintenance.
- Collaborate with analysts, architects, and source-system teams to deliver reliable, curated data products.
- 8+ years of experience in data engineering, ETL/ELT development, or related roles.
- Strong hands-on experience with Databricks, PySpark, and SQL.
- Experience with Delta Lake and large-scale data processing.
- Knowledge of Unity Catalog and data governance concepts.
- Experience working with Azure or AWS cloud platforms.
- Hands-on experience with Azure Data Factory (ADF) and Databricks Workflows.
- Understanding of CI/CD practices and deployment automation.
- Strong knowledge of data pipeline design, performance tuning, and optimization.
- Experience handling structured and semi-structured datasets.
Requirements
- 8+ years of experience in data engineering, ETL/ELT development, or related roles.
- Strong hands-on experience with Databricks, PySpark, and SQL.
- Experience with Delta Lake and large-scale data processing.
- Knowledge of Unity Catalog and data governance concepts.