In short
Data engineer at Pictet Tech in Lisbon building cloud data pipelines on AWS (S3, Lambda, RDS, SQS, IAM), transforming raw data from APIs, FTP/SFTP into structured formats via batch and streaming pipelines with monitoring, using Python (Pandas) and complex SQL in an Agile, CI/CD team.
About the role
Pictet Tech in Lisbon is seeking a data engineer to build cloud-based data pipelines and transform raw data from APIs, FTP, and SFTP into structured formats. You will architect and deploy batch and streaming pipelines with monitoring for data analysts and business users.
Join a cross-functional team using AWS services (S3, Lambda, RDS, SQS, IAM) and write complex SQL with Python (Pandas). Agile, CI/CD, and collaboration are essential as we grow in Lisbon.
Requirements
- Build cloud-based data pipelines, transforming raw data from APIs, FTP and SFTP into structured formats
- Architect and deploy batch and streaming pipelines with monitoring
- Experience with AWS services: S3, Lambda, RDS, SQS, IAM
- Write complex SQL
- Python with Pandas
- Agile ways of working, CI/CD and collaboration