In short
An experienced Python data engineer / database developer in Chennai who builds automation utilities, reconciliation frameworks, and complex SQL/T-SQL solutions for enterprise data migration, validation, and reporting across Azure data services, data warehouses, and platforms like Murex and FDR.
About the role
Role Overview
We are looking for an experienced Python Data Engineer / Database Developer to support enterprise data transformation, migration, reconciliation, validation, and reporting initiatives.
The candidate should have strong hands-on expertise in Python, advanced SQL, data analysis, ETL validation, source-to-target mapping, and data quality management. The role involves working with multiple enterprise platforms, including Murex, FDR, data warehouses, APIs, Azure data services, and reporting systems.
This is a combination of Python development, database engineering, data reconciliation, and migration testing—not a conventional Python application development role.
Key Responsibilities
Python Development & Automation
We are looking for an experienced Python Data Engineer / Database Developer to support enterprise data transformation, migration, reconciliation, validation, and reporting initiatives.
The candidate should have strong hands-on expertise in Python, advanced SQL, data analysis, ETL validation, source-to-target mapping, and data quality management. The role involves working with multiple enterprise platforms, including Murex, FDR, data warehouses, APIs, Azure data services, and reporting systems.
This is a combination of Python development, database engineering, data reconciliation, and migration testing—not a conventional Python application development role.
Key Responsibilities
Python Development & Automation
- Develop reusable Python applications, libraries, and automation utilities for data extraction, transformation, cleansing, validation, and reconciliation.
- Use Pandas, NumPy, OpenPyXL, Requests, SQLAlchemy, and PyODBC for data processing.
- Implement OOP concepts, exception handling, logging, debugging, and unit testing.
- Optimize Python applications for processing large data volumes.
- Perform source-to-target data profiling and validation across enterprise systems.
- Identify missing records, duplicates, mismatches, aggregation issues, and transformation defects.
- Develop reconciliation frameworks, validation rules, and exception reports.
- Investigate production data discrepancies and perform root cause analysis.
- Develop complex SQL/T-SQL queries, stored procedures, functions, views, indexes, and database utilities.
- Work with SQL Server, Azure SQL Database, and data warehouses.
- Perform query optimization, indexing, execution-plan analysis, and performance tuning.
- Support database design and dimensional modelling.
- Prepare source-to-target mapping documents and field-level transformation specifications.
- Define business rules, data dictionaries, metadata, and lineage documentation.
- Support mock migrations, migration rehearsals, production migration, and post-migration validation.
- Validate ETL pipelines, transformation logic, inbound/outbound feeds, and data balancing.
- Perform data, reconciliation, migration, integration, regression, and functional testing.
- Prepare SQL validation scripts, test cases, expected results, and defect reports.
- Support UAT and release validation.
- Support Azure Data Factory, Azure SQL, Azure Functions, Blob Storage, ADLS Gen2, and Key Vault.
- Work with Azure DevOps for CI/CD and deployment activities.
- Monitor and troubleshoot Azure data pipelines.
- Investigate production incidents, resolve data issues, and maintain support documentation.
- 5+ years of hands-on Python development experience.
- Strong Python programming, OOP, modular development, design patterns, debugging, and performance optimization.
- Practical experience with Pandas, NumPy, OpenPyXL, Requests, SQLAlchemy, and PyODBC.
- 5+ years of SQL development experience.
- Strong expertise in SQL/T-SQL, stored procedures, functions, views, indexing, query optimization, and performance tuning.
- Experience with SQL Server, Azure SQL Database, and data warehouses.
- Strong data engineering and analysis experience covering:
- Source-to-target mapping.
- Data migration and reconciliation.
- Data profiling and validation.
- Data quality assessment.
- Data lineage and governance.
- Business rule validation and root cause analysis.
- Hands-on ETL, data, reconciliation, migration, integration, functional, and regression testing experience.
- Experience preparing test cases, validation scripts, expected results, and test evidence.
- Ability to work with business users, architects, developers, DBAs, and QA teams.
- Murex and FDR platform experience.
- Dremio, particularly TViews/CViews.
- Azure Data Factory and Azure Functions.
- Azure DevOps and CI/CD.
- Power BI and data warehousing.
- Banking, financial services, or capital markets domain experience.
- Agile methodologies and DevOps practices.