The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/AI & Data/Beyond The Pilot: Enterprise AI in Action
Beyond The Pilot: Enterprise AI in Action artwork

Agents Ate the UI: Data is Your Only Moat with LlamaIndex

Beyond The Pilot: Enterprise AI in Action · 2026-04-29 · 45 min

0:00--:--

Episode notes

The CEO who built one of the most-starred RAG frameworks on GitHub (47,000 stars) just publicly declared that frameworks like his are becoming obsolete - and then pivoted his entire company around that conclusion. Jerry Liu, CEO and co-founder of LlamaIndex, joins Matt Marshall and Sam Witteveen to explain exactly what broke in the AI stack, why 95% of his team's code is now AI-generated, and where the real defensibility in enterprise AI infrastructure actually lives in 2026. The conversation covers the specific architectural shift that made RAG orchestration frameworks less central: agent reasoning has improved to the point where dumb tools plus smart agents outperform sophisticated retrieval pipelines, coding agents have collapsed the cost of custom integrations, and model providers like Anthropic are consolidating the harness layer around MCP, sandboxes, and session state. Jerry walks through Anthropic's managed agent diagram as a real architectural reference point and explains why engineering leaders should prioritize modular interfaces over implementation investment - because parts of your current stack will need to be thrown away in months, not years.

More from Beyond The Pilot: Enterprise AI in Action

All episodes →
  • Routing Wars: Which Model Gets the Workload?68 / 100
  • Small Models, Massive Wins: The New Shopify AI Formula85 / 100
  • Weaponize Tokenmaxing: MassMutual’s ROI Engine
  • Building a 30% Better AI: The Taste Graph Moat
  • GPU Hoarding is Over. The $401B Reality Check
Explore the best B2B AI & Data podcasts →
All Beyond The Pilot: Enterprise AI in Action episodes →