In short
Lead Data Engineer designing and building scalable data pipelines with Databricks, Lakeflow Connect, and Delta Lake, ingesting from Oracle, MySQL, and SQL Server into batch and streaming ETL/ELT workflows while providing architecture leadership across engineering teams.
About the role
Pyramid Consulting, Inc. seeks a Lead Data Engineer to drive design and implementation of scalable data pipelines using Databricks, Lakeflow Connect, and Delta Lake.
The role emphasizes ingestion from Oracle, MySQL, and SQL Server, building batch and streaming ETL/ELT workflows, and delivering robust data platform solutions with leadership across engineering teams. Ideal candidates bring 8+ years in data engineering, hands-on Databricks expertise, and a track record of architecture decisions and
Requirements
- 8+ years of data engineering experience
- Hands-on Databricks expertise
- Track record of architecture decisions and technical leadership
- Experience with Databricks, Lakeflow Connect, and Delta Lake
- Ingestion from Oracle, MySQL, and SQL Server
- Building batch and streaming ETL/ELT workflows