About the role
Responsibilities:
- Build and maintain real-time and batch data pipelines.
- Develop data processing systems to handle large datasets.
- Build data ingestion and transformation workflows.
- Work with Product, Analytics, and Infrastructure teams to ensure data quality and reliability.
- Develop APIs and data models for analytics and machine learning.
- Improve database performance, storage, and ETL pipelines.
Requirements:
- Experience in Data Engineering.
- Strong knowledge of Python; Java or Scala is a plus.
- Experience with Kafka, Spark Streaming, or Flink.
- Understanding of data modelling, distributed systems, and API integration.
- Good knowledge of SQL, NoSQL, and AWS services like S3, EMR, Redshift, Glue, and Kinesis.
- Experience with web scraping tools like Scrapy, Selenium, or Playwright.
- Knowledge of ETL pipelines and large-scale data processing.
Requirements
- Experience in Data Engineering.
- Strong knowledge of Python; Java or Scala is a plus.
- Experience with Kafka, Spark Streaming, or Flink.
- Understanding of data modelling, distributed systems, and API integration.
- Good knowledge of SQL, NoSQL, and AWS services like S3, EMR, Redshift, Glue, and Kinesis.
- Experience with web scraping tools like Scrapy, Selenium, or Playwright.
- Knowledge of ETL pipelines and large-scale data processing.