About the role
We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing data solutions using Python, PySpark, and SQL. As a Senior Data Engineer, you will play a crucial role in managing and optimizing our data pipelines, ensuring data integrity, and supporting data-driven decision-making across the organization.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes using Python and PySpark.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Optimize SQL queries for performance and efficiency, ensuring timely access to data.
- Monitor and troubleshoot data pipeline issues, implementing solutions to improve reliability and performance.
- Document data processes and workflows to ensure knowledge sharing and compliance with best practices.
- Stay updated with the latest industry trends and technologies related to data engineering and analytics.
Required Skills:
- Proficiency in Python and experience with PySpark for big data processing.
- Strong SQL skills for data manipulation and querying.
- Experience with data warehousing concepts and tools.
- Familiarity with cloud platforms and data storage solutions is a plus.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills to collaborate effectively with cross-functional teams.
If you are passionate about data engineering and want to make a significant impact in a fast-paced environment, we encourage you to apply for this exciting opportunity.