About the role
Hackajob seeks a Data Engineer to design, develop and maintain data solutions for generation, collection and processing. You will build efficient data pipelines and ensure data quality across systems to enable smooth migration and deployment.
Responsibilities include optimizing workflows, collaborating with cross-functional teams, and documenting data processes for stakeholders. Strong PySpark skills and a focus on scalability are essential.
Serve as SME and work independently. Actively participate in team discussions. Propose solutions to work-related problems. Collaborate with cross-functional teams to design scalable data solutions. Monitor and optimize data workflows for performance and reliability. Document data processes and communicate with stakeholders. Mentor junior team members by sharing knowledge. Minimum 3 years of PySpark experience. Experience building data pipelines and ETL workflows. Strong understanding of distributed computing and big data frameworks. Ability to troubleshoot and optimize data processing jobs. Familiarity with data storage solutions and data modeling concepts. Knowledge of data quality assurance and validation techniques.Skills
Interested in this role?
You'll apply directly on Hackajob's careers site.