About the role
What This Job Is
This role has a critical impact on the efficiency of data handling and analytics. Data Engineers enable seamless integration and processing of data to support various business intelligence initiatives.
What You Will Own
- Design and implement robust data pipelines leveraging Pyspark and Databricks for efficient data transformation.
- Collaborate with data scientists and analysts to gather and refine data requirements, ensuring high-quality output.
- Develop and execute data integration solutions on Google Cloud Platform (GCP) to maintain data availability across platforms.
- Monitor, analyze, and optimize existing workflows for performance enhancements and scalability.
- Diagnose and resolve issues related to data processing swiftly.
Skills That Matter
- Proficiency in Pyspark and Databricks, specifically for data engineering tasks.
- Strong experience with Google Cloud Platform (GCP), particularly in relation to data storage solutions.
- Familiarity with data modeling techniques, ETL processes, and concepts of data warehousing.
- Solid problem-solving skills with a keen attention to detail.
- Effective communication skills for collaboration with cross-functional teams.