About the role
- As a Product Engineer on the Dedicated Inference team, you’ll shape the state-of-the-art developer experience for deploying and operating AI workloads in production. From the CLI and SDKs to APIs, observability, and debugging workflows, you’ll build the tools customers rely on every day to manage mission-critical inference deployments
- Few teams at Baseten have as much breadth and visibility as Dedicated Inference. The team is often at the forefront of new product development, giving engineers the opportunity to shape the experience of some of our most important customers
- Implement new features and products for the team
- Design ergonomic APIs and abstractions to solve customer problems
- Fix bugs and resolve customer issues with urgency
- Work across the stack - regardless of where you start, you’ll end up touching both React Components and Kubernetes Pods
- Work closely with the product and forward deployed engineering teams to develop and drive new product ideas
- You’ll get to work on these types of projects as part of our Dedicated Inference team:
- Chains for multi-component workflows
- Asynchronous inference
- Model APIs for frontier models
- Model training built for production inference
Benefits
- Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive
- Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better
- Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day
- Full healthcare coverage. Medical, dental and vision insurance for you and your family
- Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work
- Company-sponsored 401(k) for you to contribute to
- Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen
- Strong collaboration and communication skills
- Proficient coding abilities in one or more popular programming or scripting languages; Python, Go, or Javascript proficiency is a plus
- Familiarity with web applications & databases
- Interest in ML/AI infrastructure and willingness to learn
- Bachelor’s degree or higher in Computer Science or related field
- Good taste in product, particularly developer-oriented tools
- If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you