About the role
Cisco Systems, Inc. is hiring for a senior SRE/Platform Engineer to scale the AI services stack powering Splunk AI Platform and Services. You will manage multi-tenant LLM inference, model serving, and MCP across global cloud and GPU clusters, while ensuring reliability and cost efficiency.
You’ll build automation for seamless rollouts, autoscaling, canary deployments, and self-healing. Strong emphasis on observability, incident response, and collaboration with AI researchers and product teams.
Scale Core AI Services: Operate and optimize multi-tenant LLM inference, model serving, VectorDB/RAG, and MCP platforms across cloud and GPU clusters. Drive Platform Resiliency: Establish and monitor SLOs/SLIs, automated health checks, and observability dashboards. Automate Operations & Toil Reduction: Build automation for rollouts, autoscaling, canary deployments, self-healing, and DR. Optimize GPU & Inference Performance: Tune throughput, latency, scheduling, batching, caching, and resource allocation using Kubernetes, vLLM, and Ray. Incident Command & Prevention: Lead complex production incident response and root-cause analyses, implement systemic remediations. Cross-Functional Enablement: Partner with AI researchers and platform teams on PRRs and on-call rotation. Bachelor’s degree in CS/Engineering with 5+ years of relevant experience, or Master’s with 3+ years. 3+ years of programming in Python, Go, or Java building automation, tooling, or production backend services. Solid experience running distributed, containerized systems in production using Kubernetes, microservices, and CI/CD. Proven background in production operations, distributed troubleshooting, and monitoring stacks (Prometheus, Grafana, Splunk, or OpenTelemetry). Hands-on working knowledge of AWS, Azure, or GCP.