In short
Senior Data Engineer designing, building and optimizing scalable data pipelines and analytics platforms across on-prem and AWS cloud, enabling batch and real-time processing plus BI. Core stack: Python, AWS EMR/S3/EC2, PySpark and Hadoop in an agile setting.
About the role
Araxi Group is seeking a Data Engineer in Gauteng to design, build, and optimize scalable data pipelines and analytics platforms. You will work across on-prem and AWS cloud environments to enable batch and real-time processing and BI solutions.
The role requires strong Python skills, AWS EMR/S3/EC2 experience, and hands-on knowledge of PySpark, Hadoop, and data modelling. Collaboration with cross-functional teams is essential in a fast-moving agile setting.
Requirements
- Strong Python skills
- AWS EMR, S3 and EC2 experience
- Hands-on knowledge of PySpark
- Hands-on knowledge of Hadoop
- Data modelling skills
- Collaboration with cross-functional teams in an agile environment