In short
Lead Data Engineer at Paytm Labs in Toronto, partnering with the Platform Engineering team to design and tune petabyte-scale data pipelines using Spark, Kafka, Python/Java and NoSQL databases, with a focus on reliability, fraud-pattern detection, and high-volume data flows in a hybrid work setup.
About the role
Become a key player at Paytm Labs as a Lead Data Engineer. Drive innovations in data engineering through designing pipelines that handle petabytes of data efficiently in a hybrid work environment.
As a Senior Data Engineer based in Toronto, you will partner with the Platform Engineering Team to develop robust data pipelines for optimal performance and reliability. Your knowledge of data frameworks and technologies will be pivotal in detecting fraud patterns and managing data structures efficiently. Participate in problem-solving to ensure smooth operations across high-volume data flows.
Key Responsibilities: • Design and implement reusable data pipelines • Fine-tune processing frameworks for optimal performance • Maintain ongoing data flow safety and reliability • Develop data structures that enhance processing and storage • Share insights on new data technologies with the team
Requirements: • Bachelor's degree in Computer Science or related fields • Expertise in Spark, Kafka, Python or Java • Experience with high-frequency data handling • Familiarity with NoSQL databases for data management • Ability to manage complex data ingestion and transformation
Join Paytm Labs to innovate and excel in the fintech landscape with cutting-edge data solutions.
As a Senior Data Engineer based in Toronto, you will partner with the Platform Engineering Team to develop robust data pipelines for optimal performance and reliability. Your knowledge of data frameworks and technologies will be pivotal in detecting fraud patterns and managing data structures efficiently. Participate in problem-solving to ensure smooth operations across high-volume data flows.
Key Responsibilities: • Design and implement reusable data pipelines • Fine-tune processing frameworks for optimal performance • Maintain ongoing data flow safety and reliability • Develop data structures that enhance processing and storage • Share insights on new data technologies with the team
Requirements: • Bachelor's degree in Computer Science or related fields • Expertise in Spark, Kafka, Python or Java • Experience with high-frequency data handling • Familiarity with NoSQL databases for data management • Ability to manage complex data ingestion and transformation
Join Paytm Labs to innovate and excel in the fintech landscape with cutting-edge data solutions.
Requirements
- Bachelor's degree in Computer Science or related fields
- Expertise in Spark, Kafka, Python or Java
- Experience with high-frequency data handling
- Familiarity with NoSQL databases for data management
- Ability to manage complex data ingestion and transformation