In short
Senior Data Engineer building and maintaining 7-Eleven's data platform: designing scalable data pipelines, ETL/ELT workflows, and data models using Python, SQL, Spark/PySpark, Airflow, and Databricks on AWS/Azure, while mentoring junior engineers and partnering with business stakeholders.
About the role
Job Description
We are looking for an experienced Senior Data Engineer to join our team at 7-Eleven. The ideal candidate will have strong expertise in data engineering, data modeling, Python, SQL, PySpark, and cloud technologies, along with experience designing scalable data platforms and leading engineering initiatives.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and data platform solutions.
- Build and optimize ETL/ELT workflows using Python, SQL, Spark, and PySpark.
- Develop and maintain data models, data lakes, and data warehouse solutions.
- Work with cloud platforms such as AWS and Azure to build reliable data solutions.
- Manage data orchestration and processing using Airflow, Databricks, and Spark.
- Optimize data workflows for performance, scalability, and cost efficiency.
- Lead and mentor junior data engineers and drive engineering best practices.
- Collaborate with product managers, analysts, architects, and business stakeholders.
- Translate business requirements into technical solutions and data architecture.
- Contribute to engineering standards, documentation, and platform improvements.
Required Skills
- 6+ years of experience in Data Engineering.
- Minimum 2+ years of experience in Data Modeling.
- Strong hands-on experience with Python, SQL, Spark, and PySpark.
- Experience with AWS and/or Azure cloud platforms.
- Strong understanding of ETL/ELT, data lakes, data warehousing, and database architecture.
- Experience with batch and streaming data processing.
- Hands-on experience with Apache Airflow and Databricks.
- Experience with Tableau or Power BI.
- Proven experience leading or mentoring data engineering teams.
- Strong communication and stakeholder management skills.
Good to Have
- Experience with Azure Databricks.
- Experience with Customer Data Platforms (CDP), such as Hightouch.
- Experience in retail or consumer-facing data platforms.
Education
Bachelor's degree in Computer Science, Engineering, Mathematics, or a related quantitative field.