About the role
You will own the production improvement loop for AI-powered go-to-market workflows. You will instrument agent workflows, investigate failures, design behavior improvements, build backend services and feedback pipelines, run experiments, and measure customer and business outcomes.
Responsibilities
- Own the production improvement loop for agent behavior, feedback, evaluation, experimentation, and business outcomes
- Instrument agent workflows and downstream outcomes
- Define quality standards, evaluation datasets, regression coverage, and production monitoring
- Investigate agent underperformance
- Design and ship improvements to prompting, context, decision logic, tool use, and human-review paths
- Build backend services, APIs, data models, and feedback pipelines
- Run experiments, production replays, and staged rollouts
- Implement safeguards for privacy, security, reliability, and human oversight
Requirements
- Software engineering
- Backend engineering
- Applied AI
- Product engineering
- AI agent
- LLM
- Evaluation
- Regression testing
- Experimentation
- Python
- API
- Data pipeline
- Stateful workflow
- Production service
- Prompting
- Context design
- Human-in-the-loop
- Privacy
- Security
- Reliability
Benefits
- Equity
- Medical, dental, and vision insurance
- Health Savings Account contributions
- Health FSA
- Dependent Care FSA
- Commuter expense account
- 401(k) employer match
- Paid parental leave
- Paid medical and caregiver leave
- Paid time off
- Paid holidays
- Paid sick or safe time
- Mental health and wellness support
- Employer-paid life and disability coverage
- Daily office meals
- Meal delivery credits
- Relocation support
- Charitable donation matching
- Wellness stipend
Requirements
- Software engineering
- Backend engineering
- Applied AI
- Product engineering
- AI agent