About the role
Hunton Group is seeking to fill a hands-on Data Engineer to design, build, and maintain our enterprise data platform using Microsoft Fabric. This role will lead the development of a scalable Lakehouse and Warehouse architecture that integrates data from Microsoft Dynamics GP/WennSoft, Salesforce.com, Excel and CSV files, SQL Server, APIs, and other enterprise data sources.
The Data Engineer will work closely with Power BI Analysts and Business Analysts to transform business requirements into reliable, governed, and high-performing data structures that support enterprise reporting, self-service analytics, and future AI and advanced analytics initiatives.
Key Responsibilities
-
Design, build, and maintain Microsoft Fabric Lakehouse and Warehouse that serve as the centralized foundation for enterprise reporting and analytics.
-
Design and implement Star Schema data models, including fact and dimension tables, optimized for Power BI, analytics, and self-service BI.
-
Develop scalable data architecture using Microsoft Fabric, OneLake, Lakehouse, Warehouse, and Delta tables, selecting the appropriate technology and storage pattern for each workload.
-
Build and maintain data ingestion and transformation processes using Fabric Data Factory Pipelines, Dataflow Gen2, notebooks, SQL, and other Fabric-native capabilities.
-
Integrate data from multiple enterprise sources, including Microsoft Dynamics GP/WennSoft, Salesforce.com, SQL Server, Excel and CSV files, APIs, and other operational systems.
-
Design appropriate Bronze, Silver, and Gold data layers to separate raw source data, standardized and cleansed data, and business-ready analytical data.
-
Develop robust transformation processes for data cleansing, validation, standardization, and deduplication
-
Standardize business logic, KPIs, key metrics, and data definitions across source systems to establish a consistent and trusted enterprise data foundation.
-
Design and implement incremental and delta-loading strategies, including CDC, and other techniques to improve data freshness while minimizing unnecessary processing.
-
Evaluate and implement appropriate Fabric ingestion patterns, including Pipelines, Mirroring, Shortcuts, Dataflow Gen2, notebooks, and SQL-based transformations.
-
Leverage Microsoft OneLake to centralize enterprise analytical data and reduce unnecessary movement and duplication of data.
-
Implement comprehensive data quality and reconciliation controls, including completeness, accuracy, duplicate detection, referential integrity, source-to-target balancing, and load validation.
-
Implement processes for data lineage, metadata management, auditability, and monitoring across the Fabric environment.
-
Maintain technical documentation including data dictionaries, source-to-target mappings, data flows, transformation logic, dependencies, business rules, and architecture documentation.
-
Ensure Fabric solutions align with organizational data governance, security, naming, workspace, development, deployment, and master data management standards.
-
Optimize Lakehouse, Warehouse, and SQL workloads for performance, scalability, efficient data processing, and large data volumes.
-
Collaborate closely with Power BI Analysts to ensure Fabric data structures effectively support Power BI semantic models, Direct Lake, Import, and DirectQuery, selecting the appropriate architecture based on performance and reporting requirements.
-
Support the development of centralized, reusable semantic models that provide consistent dimensions, measures, KPIs, and business logic across Power BI reports.
-
Implement Git/source control and deployment practices for Microsoft Fabric artifacts to support controlled development, testing, documentation, and production releases.
-
Design and implement operational processes for pipeline monitoring, logging, error handling, retries, notifications, reconciliation, and troubleshooting.
-
Document end-to-end data lineage and dependencies, from source systems through Fabric Lakehous and Warehous to Power BI semantic models and reporting.
-
Build the Microsoft Fabric platform with future capabilities in mind, including AI, machine learning, Copilot, real-time analytics, and other advanced analytics use cases.