In short
Data Engineer at Capgemini Engineering designing, building, and maintaining scalable ETL/ELT pipelines with Python and Databricks. Works with Spark, PySpark, Delta Lake, and Lakehouse architectures, integrating data from databases, APIs, files, and cloud storage while ensuring data quality — in a remote-friendly setup based in Aguascalientes, Mexico.
About the role
Capgemini Engineering is seeking a Data Engineer to design, develop, and maintain scalable ETL/ELT data pipelines using Python and Databricks, joining a global team of engineers to help organizations leverage data for impactful results.
You will work with Spark, PySpark, Delta Lake, and Lakehouse architectures, integrating data from databases, APIs, files, and cloud storage while ensuring data quality and reliability in a remote-friendly setup.
Requirements
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and Databricks
- Experience with Spark, PySpark, Delta Lake, and Lakehouse architectures
- Integrate data from databases, APIs, files, and cloud storage
- Ensure data quality and reliability