The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/AI & Data/Beyond The Pilot: Enterprise AI in Action
Beyond The Pilot: Enterprise AI in Action artwork

GPU Hoarding is Over. The $401B Reality Check

Beyond The Pilot: Enterprise AI in Action · 2026-05-13 · 16 min

0:00--:--

Episode notes

Enterprise GPU hoarding is over. LinkedIn CTO Erran Berger and VentureBeat analyst Rob Strechay break down what comes next - and the infrastructure math most enterprises are only now being forced to confront. VentureBeat's Q1 research shows GPU availability anxiety dropped from 20.8% to 15.4% among enterprise teams, while cost-per-inference and TCO concerns jumped from 34% to 41% - a number that's still climbing. The hoarding phase is giving way to an audit phase, and the companies that didn't build the instrumentation to understand their workloads are now paying for it. Erran Berger explains how LinkedIn runs one of the few remaining at-scale applied ML shops outside the hyperscalers - owning the full stack from bare metal GPU clusters to member-facing products. That means LinkedIn engineers can optimize custom CUDA kernels, compress embeddings, prune models for throughput, and adapt networking and storage per workload - trade-offs that are simply unavailable on public cloud instance menus. The result: a rigorous ROI framework that evaluates not just current traffic costs, but the traffic shape agents will drive in 2 - 3 years.

More from Beyond The Pilot: Enterprise AI in Action

All episodes →
  • Routing Wars: Which Model Gets the Workload?68 / 100
  • Small Models, Massive Wins: The New Shopify AI Formula85 / 100
  • Weaponize Tokenmaxing: MassMutual’s ROI Engine
  • Building a 30% Better AI: The Taste Graph Moat
  • Agents Ate the UI: Data is Your Only Moat with LlamaIndex
Explore the best B2B AI & Data podcasts →
All Beyond The Pilot: Enterprise AI in Action episodes →