AI Analytics for Builders
Transform from consumer of analytics to independent operator — asking sharp questions, validating answers, shipping decisions.
Who it's for
PMs, engineers, operators, designers stepping into strategy roles
What you'll learn
- ➔ Transform vague ideas into decision-forcing questions
- ➔ Design metrics with clear numerators, denominators, and edge cases
- ➔ Decompose metric changes into mix shift vs. within-segment drivers
- ➔ Write testable hypotheses with success criteria and decision rules
- ➔ Use AI to accelerate analysis while validating outputs
Instructors
Shane Butler & Sravya Madipalli & Hai Guan
Upcoming cohorts
April 20, 2026
AI Evals for Product Development
Practical, hands-on methods to evaluate, measure, and improve AI products using data science.
Who it's for
PMs, Data Scientists, Analysts, ML Engineers building AI products
What you'll learn
- ➔ Design observable AI systems with proper logging and trace architecture
- ➔ Run structured failure analysis on production data
- ➔ Translate AI quality metrics to user behavior and business results
- ➔ Build evaluation workflows from offline tests through production monitoring
- ➔ Make ship/iterate/pause/rollback decisions based on evaluation data
Instructors
Shane Butler
Upcoming cohorts
April 6, 2026
June 15, 2026
Free Workshops
Try a free live workshop
Free live sessions on AI analytics and AI evaluation. Open to anyone.
Stay up to date with AI analytics
Get the latest on AI-powered analytics — new frameworks, course launches, and insights from practitioners.
No spam. Unsubscribe anytime.
Next cohort starts April 6
Whether you're looking for courses, team training, or just want to talk shop — we'd love to hear from you.
Looking for team training or consulting? Learn more →