The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/AI & Data/Practical AI
Practical AI artwork

AI incidents, audits, and the limits of benchmarks

Practical AI · 2026-02-13 · 43 min

0:00--:--

Topics in this episode

Neural networksArtificial intelligenceMachine LearningDeep Learningchangelog

Episode notes

AI is moving fast from research to real-world deployment, and when things go wrong, the consequences are no longer hypothetical. In this episode, Sean McGregor, co-founder of the AI Verification & Evaluation Research Institute and also the founder of the AI Incident Database, joins Chris and Dan to discuss AI safety, verification, evaluation, and auditing. They explore why benchmarks often fall short, what red-teaming at DEFCON reveals about machine learning risks, and how organizations can better assess and manage AI systems in practice. Featuring: Sean McGregor - LinkedIn Chris Benson - Website , LinkedIn , Bluesky , GitHub , X Daniel Whitenack - Website , GitHub , X Links: AI Verification & Evaluation Research Institute AI Incident Database 38th convening of IAAI BenchRisk State of Global AI Incident Reporting Upcoming Events: Register for upcoming webinars here !

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

  • Building the Internet of Medicine: How AI Could Transform Children's Healthcare | Dr. Timothy Chou - Founder, Pediatric MoonshotProgress, Potential, and Possibilities Podcast / Show · on Artificial intelligence92 / 100
  • Scaling TensorFlow, Navigating Startup Pivots, ML Edge Infrastructure and AI Inference Strategy w/ Rajat MongaEngineering Founders · on Deep Learning85 / 100
  • How B2B Marketers Use Predictive Lead Scoring for Enterprise SalesB2B Marketing with Fexingo · on Machine Learning85 / 100
  • Jack Hidary, CEO of Sandbox AQ | The Third Quantum RevolutionThe BreakLine Arena · on Neural networks83 / 100
  • DOP 356: Warehouse Robots Are a Distributed SystemDevOps Paradox · on Neural networks83 / 100
  • On Device AI vs Cloud AI, How Sensory Built 30+ Years of Voice Innovation with Todd MozerBuilt to Scale: B2B Growth with Rym Benchaar · on Neural networks83 / 100

More from Practical AI

All episodes →
  • Reconstructing how OpenAI agents attacked Hugging Face80 / 100
  • Image Generation and Visual Intelligence with Black Forest Labs86 / 100
  • AIUC-1: Building trust in AI agents74 / 100
  • Zero Trust for AI Agents61 / 100
  • Breaking down the 2026 Stanford AI Index Report53 / 100
Explore the best B2B AI & Data podcasts →
All Practical AI episodes →