In short
Design and optimize end-to-end data pipelines using Databricks, PySpark, and SQL, building Bronze-Silver-Gold lakehouse architectures with strong data quality and scalable production deployments, while collaborating with data scientists and analysts. Fully remote with flexible hours and USD or local currency pay.
About the role
BairesDev is seeking a Data Engineer (Databricks) to design and optimize end-to-end data pipelines, leveraging Databricks, PySpark, and SQL. You will work on Bronze-Silver-Gold lakehouse architectures, ensuring data quality and scalable production deployments.
The role emphasizes collaboration with data scientists and analysts, maintaining data integrity, and enabling advanced analytics and ML workloads. 100% remote with flexible hours and USD or local currency compensation.
Requirements
- Experience designing and optimizing end-to-end data pipelines
- Proficiency with Databricks
- Proficiency with PySpark
- Strong SQL skills
- Experience with Bronze-Silver-Gold lakehouse architectures
- Ensuring data quality and data integrity
- Experience with scalable production deployments
- Collaboration with data scientists and analysts
Nice to have
- Enabling advanced analytics and ML workloads