In short
Senior Databricks engineer designing, building, and operating batch and near real-time data pipelines and standardized data models on the Azure data platform (Databricks, Data Factory, Synapse, ADLS), enabling analytics for distribution finance, commissions, and advisory performance.
About the role
Job Location: Bangalore/Kochi/Pune/Mumbai/Noida
Immediate joiners preferred
Job Summary:
Sr. Databricks Engineer In this role, you will work with a cross functional team to support the business unit by designing and delivering robust data solutions and pipelines leveraging on Data Platform. You will design, build and operate scalable ingestion and transformation workflows (batch and, where required, near real-time), implement standardized data models and a single view of customers/advisers, and enable analytics and reporting for distribution finance, commissions, advisory performance, and management insights. You will partner closely with business and technology stakeholders to ensure data quality, governance, security, and reliable delivery aligned to business requirements and IT standards.
Job Description:
- Build Data Solutions and Pipelines
- Operate and Support Data Pipelines
- Controlled Data Extracts & Reporting Enablement
- Governance, Security & SDLC Compliance
- Stakeholder Management
- Cross-Functional Delivery
Technical Proficiency: Experienced in one or more of the following technologies and practices:
- Azure data platform: Synapse, Data Lake (ADLS), Data Factory, Databricks; catalog/governance tools (e.g., Unity Catalog) and RBAC-based access controls
- PySpark / Python / SQL (Scala is a plus); data testing and data quality validation patterns
- Engineering toolchain: GitHub/Git, CI/CD pipelines, JIRA, Confluence
• DevOps & Automation: Working knowledge of DevOps practices (version control, build/release automation, monitoring).
Requirements
- 5-8 years of experience
- Experience with Azure data platform: Synapse, Data Lake (ADLS), Data Factory, Databricks
- Catalog/governance tools (e.g., Unity Catalog) and RBAC-based access controls