In short
Python developer role in Mississauga focused on big data engineering: building and optimizing ETL pipelines that process large data volumes using PySpark/Spark, Pandas, NumPy, SQL/Oracle, MongoDB, and Hive.
About the role
Python (core & Advance preferable), Pyspark (Advanced Level)- Data processing, Engineering, ETL Development(using Oracle, mongo, Hive), Advanced Optimization Techniques for processing Large volume of data.
Pandas - Advanced level,
Numpy - Intermediate Level
SQL/Oracle - Advanced Level
spark - Advanced level
High level of coding knowledge and Big data processing requirement is must..
Requirements
- Python (core & advanced preferable)
- PySpark at advanced level for data processing, engineering, and ETL development
- ETL development using Oracle, MongoDB, and Hive
- Advanced optimization techniques for processing large volumes of data
- Pandas - advanced level
- NumPy - intermediate level
- SQL/Oracle - advanced level
- Spark - advanced level
- High level of coding knowledge and big data processing experience is a must