In short
Walk-in hiring for a Senior Software Engineer (6+ years experience) working on distributed batch and real-time data processing with Apache Spark, Flink, and Kafka/MSK on AWS and Azure, applying data architecture patterns like Medallion and star-schema modelling. Positions open in Kochi, Bengaluru, and Thiruvananthapuram.
About the role
6+ years of professional software engineering experience
Hands-on experience with Apache Spark and Apache Flink for distributed batch and real-time stream processing.
Strong understanding of Apache Kafka / Amazon MSK, including topics, partitions, producers, consumers, consumer groups, retries and failure handling.
Practical exposure to AWS and Azure cloud services, including AWS S3, Azure Blob Storage and cloud-based data integration.
Understanding of data architecture patterns, including Medallion Architecture (Bronze, Silver and Gold layers).
Experience with NoSQL databases and analytical data modelling concepts, including star-schema modelling.
Understanding of event-driven architectures, asynchronous communication, API design and distributed systems.
To adhere to ISMS policies and procedures
Requirements
- 6+ years of professional software engineering experience
- Hands-on experience with Apache Spark and Apache Flink for distributed batch and real-time stream processing
- Strong understanding of Apache Kafka / Amazon MSK, including topics, partitions, producers, consumers, consumer groups, retries and failure handling
- Practical exposure to AWS and Azure cloud services, including AWS S3, Azure Blob Storage and cloud-based data integration
- Understanding of data architecture patterns, including Medallion Architecture (Bronze, Silver and Gold layers)
- Experience with NoSQL databases and analytical data modelling concepts, including star-schema modelling