In short
Backend engineer owning the AI inference and orchestration layer between models and users: building and operating production APIs, designing inference pipelines, monitoring/alerting on incidents, and optimizing latency and throughput using Python, PyTorch, Node.js, SQL/NoSQL, and Docker.
About the role
Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.
You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered features, and service boundaries around models. You will optimize real-world performance while supporting mobile and desktop clients.
Key Responsibilities:
- Build and operate backend systems serving AI features
- Design inference pipelines and orchestration layers
- Define service boundaries around models
- Monitor, log, alert, and respond to incidents
- Optimize latency and throughput across inference systems
Requirements:
- Experience running high-throughput, low-latency services
- Familiarity with LLMs, embeddings, and multimodal inference
- Experience with Python, NodeJs, and PyTorch
- Knowledge of SQL, noSQL, and Docker
- Bias toward shipping and learning from production behavior
Apply backend engineering expertise across AI inference, orchestration, reliability, latency, and production API performance.
Requirements
- Experience running high-throughput, low-latency services
- Familiarity with LLMs, embeddings, and multimodal inference
- Experience with Python, NodeJs, and PyTorch
- Knowledge of SQL, noSQL, and Docker
- Bias toward shipping and learning from production behavior