About the role
Robotic Technologies Automation in Stamford, CT seeks a Data Engineer for an 11-month contract, with possible extension. The role focuses on building end-to-end data pipelines and migrating streaming platforms to Azure.
You will design data warehouses/lakehouses on Azure Databricks and ADLS, integrate Kafka with Flink and Spark, mentor engineers, and ensure adherence to engineering standards across teams.
Build end-to-end data pipelines and platform components. Design and migrate streaming platforms from on-prem to Azure. Develop event-driven pipelines integrating Kafka with Flink and Spark. Build and manage the data warehouse and lakehouse on Azure Databricks and ADLS. Review code and designs, mentor developers and enforce engineering standards. Work with development, testing and implementation teams to roll out regulatory and business programs. 10+ years in IT projects, enterprise integration and SOA. Streaming experience with Flink or Spark Streaming for event-driven use cases. Design and implementation of data warehouses and lakehouses.