In short
Junior Data Engineer (1-2 years) in Hyderabad developing and maintaining ETL data pipelines with Python, PySpark, SQL, and Databricks. Day-to-day involves extracting, transforming, and loading large datasets, optimizing SQL queries, and ensuring data accuracy and quality.
About the role
Role & responsibilities
- Develop and maintain data pipelines using Python, PySpark, and SQL.
- Work on data extraction, transformation, and loading (ETL) processes.
- Perform data processing and transformation using PySpark and Databricks.
- Write, execute, and optimize SQL queries.
- Assist in building and maintaining scalable data workflows.
- Perform data cleansing, validation, and troubleshooting.
- Work with large datasets and ensure data accuracy and quality.
- Collaborate with team members to support data engineering projects.
Preferred candidate profile
- 12 years of experience in Data Engineering.
- Hands-on knowledge of Python, PySpark, and SQL.
- Basic to working knowledge of Databricks and Apache Spark.
- Understanding of ETL/ELT concepts and data pipeline development.
- Knowledge of data transformation and data processing.
- Strong analytical and problem-solving skills.
- Good communication and willingness to learn new technologies.
Requirements
Nice to have
- 1-2 years of experience in Data Engineering
- Hands-on knowledge of Python, PySpark, and SQL
- Basic to working knowledge of Databricks and Apache Spark
- Understanding of ETL/ELT concepts and data pipeline development
- Knowledge of data transformation and data processing
- Strong analytical and problem-solving skills