About the role
Orangebitsindia is seeking a Senior Data Engineer to transform raw data into robust systems and drive efficiency by aligning data with business goals.
You will design pipelines, build ETL processes, and work with Python, PySpark, Spark, and Scala, along with Hive, Airflow, Hadoop, and cloud services. Strong analytical skills and cross-source data integration knowledge are essential.
Build data pipelines for consumption by the data science team. ETL development and tooling. Write Python and SQL queries. Tune SQL queries for performance. Shell scripting (Unix/Linux) may be involved. Develop data pipelines in Spark/PySpark with SQL and Python or Scala. Knowledge of Cloud technologies (Azure/AWS/GCP) is a plus. Knowledge of Kubernetes and CI/CD concepts is beneficial. Support data integration best practices and guide QA on tests. Break down deliverables into tasks and assign to the team. Maintain/deploy ETL code and follow Agile methods. Focus on optimization wherever applicable. Communicate effectively in both written and spoken form. Participate in customer system design meetings and collect functional/technical requirements.