About the role
Atlassian's AI & ML Platform is seeking a Senior ML System Engineer to design and optimize large-scale model serving systems end-to-end. You’ll own distributed infrastructure, from global KV cache to batching, and will work on low-level GPU kernels and quantization.
On day one, expect 5+ years in software engineering, 2+ years in performance optimization, strong C/C++ or Rust, and experience with high-concurrency production serving and GPU inference engines.
Architect scalable distributed infrastructure for model serving, including load balancing and auto-scaling. Optimize latency and throughput under production workloads. Build reliable, high-concurrency serving systems handling billions of requests. Benchmark, tune, and accelerate inference engines. Create robust CI/CD pipelines for deployment and updates. Collaborate with senior ML engineers to fine-tune open-source LLMs. 5+ years of software engineering experience with system-level focus. Deep expertise in low-level systems programming and performance tuning. Experience with large-scale model serving and high concurrency environments. Health resources Volunteer days Community engagementSkills
Interested in this role?