About the role
Insight Public Sector is seeking a Senior Data Engineer to design, build, and optimize modern data platforms that enable analytics, reporting, operational intelligence, and AI‑driven solutions. You will develop scalable data pipelines across cloud environments, integrating complex sources and delivering high‑quality data solutions.
The role requires collaboration with architects, engineers, analysts, and stakeholders to modernize data environments and implement cloud‑based platforms.
Design, develop, and maintain scalable data pipelines ingesting data from varied sources. Build and support ETL/ELT solutions across cloud data platforms and analytics environments. Develop data integration frameworks for secure, efficient data movement. Design dimensional models and data structures for analytics and AI initiatives. Collaborate with architects and stakeholders to translate business requirements into scalable solutions. Apply data quality, testing, monitoring, lineage, and governance practices throughout the lifecycle. Optimize pipelines for performance, scalability, and cost efficiency. Support modernization of legacy data platforms and integrations. Implement CI/CD, automation, and source control in data engineering workflows. Troubleshoot complex issues across data platforms and integration environments. Contribute to architecture reviews and continuous improvement. 6+ years of experience in Data Engineering, Data Integration, Analytics Engineering, or related field. Advanced SQL skills, including optimization and data modeling. Experience with Python, Scala, Java, or similar languages. Experience with cloud data platforms, data warehouses, lakehouses, analytics environments. Experience with distributed processing technologies (Spark). Hands-on experience with modern data platforms (Fabric, Databricks, Snowflake, BigQuery, Redshift). Familiarity with Git-based workflows and CI/CD. Understanding of data quality, governance, lineage, security, and observability. Strong communication with technical and non-technical stakeholders. Ability to adapt to changing priorities and learn new tech quickly.