The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/Marketing/growth minded SUPERHEROES
growth minded SUPERHEROES artwork

Reduce The Cost of Being Wrong: Black Swan Tests & the Future of Experimentation - with Ryan Lucht

growth minded SUPERHEROES · 2025-11-25 · 47 min

0:00--:--

Episode notes

Ryan Lucht , Senior Technical Advocate at Datadog and Marketing Lead at Eppo, widely regarded as one of the sharpest voices in modern experimentation talks about some misconceptions of experimentaiton. Ryan’s knowledge and technical depth, contrarian thinking, and cultural pragmatism has made him a leading figure in the experimentation community. Ryan shares the origin story that hooked him into A/B testing - including the now-legendary experiment in which tripling the product price tripled revenue . From there, the conversation unfolds into an exploration of the ideas that have shaped his philosophy over the years. Why some experiments behave like “Black Swans” - rare, extreme, massively impactful outliers that reshape your business. The groundbreaking academic research showing that experiments follow a fat-tailed distribution , and why this changes everything. Why companies should radically decrease the cost of experimentation , and how Amazon and Netflix operationalized exactly that. How small and mid-sized companies can also reduce cost per experiment - even with limited traffic. The hidden cultural blockers that silently kill experimentation programs.

More from growth minded SUPERHEROES

All episodes →
  • 2025 Finale: “Everyone’s Insane”, AI, Burnout & What Actually Matters Going Forward50 / 100
  • From 100 to 200 Experiments on the Same Budget: The Scaling Playbook with Melanie Kyrklund
  • Why Experimentation Beats “Management by Hope” - Lessons from mobile.de’s Martin Schröter
  • Digging for Gold: How To Create Huge Aha Moments - with Karl Gilis
  • Experimentation Strategy: Data Looks Back, Experiments Look Forward - with Kevin Anderson
Explore the best B2B Marketing podcasts →
All growth minded SUPERHEROES episodes →