About the role
Databricks Data Engineer - SAP S/4HANA Data Migration
Location: Maumee, OH
Experience: 14+ Years
Job Summary
We are seeking an experienced Databricks Data Engineer with strong expertise in enterprise data engineering and hands-on experience supporting SAP S/4HANA data migration and data-load programs.
The ideal candidate will design and develop scalable data pipelines using Databricks to extract, cleanse, transform, validate, and prepare SAP and non-SAP data for migration into SAP S/4HANA.
The role also involves leveraging AI/ML and GenAI approaches to improve data transformation, mapping, data quality, enrichment, and reconciliation processes.
Key Responsibilities
- Design, develop, and maintain data engineering solutions using Databricks, Apache Spark, and Delta Lake.
- Build scalable ETL/ELT pipelines using PySpark, Python, and SQL.
- Support SAP S/4HANA data migration and data conversion activities.
- Extract and transform data from SAP ECC, SAP S/4HANA, legacy applications, and non-SAP systems.
- Perform data profiling, cleansing, standardization, source-to-target mapping, deduplication, and validation.
- Support mock loads, dress rehearsals, reconciliation, defect resolution, and production migration.
- Work with SAP master and transactional data, including Business Partner, Customer, Vendor, Material, Finance, Purchasing, and Sales data.
- Develop automated data-quality and reconciliation controls.
- Apply AI/ML and GenAI techniques for mapping recommendations, anomaly detection, classification, entity matching, and transformation automation.
- Implement logging, exception handling, data lineage, security, and performance optimization.
- Prepare technical documentation for data flows, mappings, transformation rules, and validation processes.
Mandatory Skills
- Strong hands-on experience with Databricks, Apache Spark, and Delta Lake.
- Strong development skills in PySpark, Python, and SQL.
- Hands-on experience with SAP S/4HANA migration, conversion, or data-load programs.
- Experience with source-to-target mapping, data cleansing, transformation, validation, and reconciliation.
- Understanding of SAP master and transactional data structures.
- Experience building reusable ETL/ELT frameworks for large-volume enterprise data.
- Working knowledge of AI/ML or GenAI concepts applicable to data engineering.
Preferred Skills
- Experience with SAP S/4HANA Migration Cockpit and migration objects.
- Knowledge of SAP ECC to S/4HANA transformation scenarios.
- Experience integrating Databricks with SAP and non-SAP data sources.
- Knowledge of Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.
- Exposure to Unity Catalog, data governance, lineage, and data-quality frameworks.
- Experience using LLMs or GenAI for metadata analysis, mapping recommendations, and data-quality automation.
- Functional exposure to SAP FI/CO, MM, or SD.
- Experience in large-scale SAP transformation programs.