The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/AI & Data/ChatGPT and Beyond with Fexingo
ChatGPT and Beyond with Fexingo artwork

Why AI Inference Is Becoming the New Compute Bottleneck

ChatGPT and Beyond with Fexingo · 2026-07-13 · 9 min

0:00--:--

Topics in this episode

NvidiaAMDAI inferencecompute bottlenecktoken pricing

Episode notes

Lucas and Luna explore the shift from training to inference as the economic bottleneck in AI. With NVIDIA up 3.4% in a week and AMD up 3.5%, they dig into why inference costs are now the crucial metric. Lucas explains how token prices are falling, but total inference demand is exploding - especially as agents and real-time applications scale. They discuss the 'inference gap' between what models can do and what deployment requires, and why this is reshaping chip design and cloud economics. A must-listen for anyone tracking where the real value in AI is moving. #AIInference #ComputeBottleneck #NVIDIA #AMD #TokenEconomics #AIAgents #LargeLanguageModels #GenerativeAI #Technology #TechStocks #AIInfrastructure #ChipDesign #CloudEconomics #DataCenters #FexingoBusiness #BusinessPodcast #ChatGPTandBeyond #ProductivityTools Keep every episode free: buymeacoffee.com/fexingo

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

  • Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysisTraining Data · on Nvidia95 / 100
  • The AI Tax: Why Your Agents Cost More Than Your People and What That Means for ScaleDisambiguation · on Nvidia95 / 100
  • Kiwi co-founded world‑builder hits $2.5 billion valuationThe Business of Tech · on Nvidia87 / 100
  • AI CEO Series: Dr. Varun SivaramNext in Tech · on Nvidia86 / 100
  • Yuval Ariav, Solo GP of Symbol Capital, on Pre-Consensus Investing, Why NextSilicon Could Be Israel's NVIDIA, and the $1.1 Trillion Market Hiding in Plain SightInvested by Aleph · on Nvidia86 / 100
  • From Amazon to Arm: The Blueprint for Scaling Tech Giants with Jason ChildSecrets of Rockstar CFOs · on Nvidia85 / 100

More from ChatGPT and Beyond with Fexingo

All episodes →
  • Why AI Companies Are Buying Presentation Software74 / 100
  • Why Palantir Stock Is Surging While AI Peers Decline72 / 100
  • How AI Model Marketplaces Are Becoming the New Operating Systems68 / 100
  • Why AI Model Marketplaces Are Becoming the New Operating Systems70 / 100
  • Neoclouds Are the New AI Infrastructure Battlefield72 / 100
Explore the best B2B AI & Data podcasts →
All ChatGPT and Beyond with Fexingo episodes →