About the role
Locations:Hyderabad/Bangalore/Chennai/Kolhapur/Visakhapatnam
Experience:5+ years
Mandatory:Need AI/ML/Datascientist with experience in Databricks
ML/AI Engineer (Databricks | Azure | AWS | MCP)
Role Summary
We are seeking a ML/AI Engineer (8+ years) to design, build, deploy, and operate production-grade machine learning and generative AI solutions on Databricks across Azure and AWS. You will own end-to-end delivery from data/feature pipelines and model training to scalable serving, monitoring, governance, and CI/CD working closely with Data Engineering, Cloud/Platform, Security, and Product teams. We need experience building an MCP server on databricks or azure. Also, experience integrating and operationalizing AI capabilities using an MCP (Model Context Protocol) server.
This assignment is focused on: Databricks, agentibricks, MCP server, APIs, Azure, (potentially AWS).
Key Responsibilities
- Solution design & delivery
- Architect and implement ML/AI solutions leveraging Databricks (workflows, notebooks, jobs) across Azure and AWS.
- Translate business needs into ML/AI system designs, technical specs, and delivery plans.
- Data & feature engineering
- Build reliable data pipelines and feature pipelines (batch/streaming where applicable).
- Implement feature reuse patterns and ensure data quality checks, lineage, and reproducibility.
- Model development (ML + GenAI)
- Develop, train, evaluate, and tune ML models (classical ML and/or deep learning as needed).
- Build and productionize GenAI patterns (prompting, RAG, evaluation), integrating tool usage via MCP server where required.
- MLOps / LLMOps
- Implement model lifecycle management: experiment tracking, model registry, versioning, approvals, and promotion.
- Establish monitoring for performance, drift, bias, latency, and cost; design retraining strategies.
- CI/CD & automation
- Create and maintain CI/CD pipelines for ML code, infrastructure, and deployment workflows.
- Enforce engineering standards: testing (unit/integration), code reviews, branching strategies, artifact management.
- Cloud & platform collaboration
- Work with platform teams on secure deployments, secrets management, network controls, and governance.
- Optimize compute and runtime costs on Databricks and cloud resources.
- Agile execution
- Break down work into epics/stories, manage delivery in JIRA, and contribute to sprint planning and retrospectives.
- Partner with stakeholders and provide clear progress updates, risks, and mitigation plans.
Required Qualifications
- 5+ years of software engineering and/or data/ML engineering experience, with significant recent focus on ML/AI.
- Strong hands-on experience with Databricks (production pipelines, orchestration, performance tuning).
- Proven experience delivering solutions on Azure and AWS (one may be primary, but both required).
- Strong programming skills in Python (and familiarity with SQL); solid software engineering practices.
- Production experience with CI/CD (e.g., build/test/release automation) and infrastructure-aware delivery.
- Strong experience using GitHub (PR workflows, branch strategies, code review practices).
- Experience working in Agile teams and managing work in JIRA.