About the role
HappyRobot Inc. is seeking a data-driven Role to advance how we measure and improve our AI-powered products.
You’ll collaborate with Product, Engineering, and ML teams to quantify model and feature performance, design experiments, and translate results into actionable product roadmaps. You will work with large-scale conversation data and workflows to deliver meaningful insights, build dashboards, and influence decisions that drive client value and operational efficiency.
Define and track product, feature, and agent-level metrics. Design, run, and interpret A/B tests for model changes, prompts, agent behavior, workflows, and product features. Measure how the performance of our agents affects client outcomes, such as task completion, operational efficiency, response quality, and automation rates. Connect offline model evaluations with production performance and real-world customer impact. Conduct deep analyses across conversations, workflows, and product usage to identify opportunities and explain differences in performance. Investigate anomalies and regressions, perform root-cause analyses, and recommend improvements. Build statistical models, simulations, and analytical frameworks to support product and ML decisions. Partner with Engineering to improve instrumentation, data quality, experimentation systems, and analytical data models. Build dashboards and self-serve tools that help teams understand product and agent performance. Communicate findings and recommendations clearly to technical and non-technical stakeholders. 4+ years of experience in Data Science, Product Analytics, or another highly quantitative product role. Experience with experimental design, A/B testing, statistics, causal inference, and hypothesis-driven analysis. Experience defining and operationalizing product and feature metrics. Ability to translate ambiguous product questions into rigorous analyses and actionable recommendations. Strong product instincts and ability to distinguish statistical significance from meaningful impact. Experience partnering closely with Product, Engineering, or Machine Learning teams. Strong written and verbal communication skills. High attention to detail and commitment to analytical accuracy. Founder mindset: ownership, independence, curiosity, and willingness to go deep. Healthcare Equity Dental & Vision