Why AI Inference Is Becoming the New Compute Bottleneck

Episode notes

Lucas and Luna explore the shift from training to inference as the economic bottleneck in AI. With NVIDIA up 3.4% in a week and AMD up 3.5%, they dig into why inference costs are now the crucial metric. Lucas explains how token prices are falling, but total inference demand is exploding - especially as agents and real-time applications scale. They discuss the 'inference gap' between what models can do and what deployment requires, and why this is reshaping chip design and cloud economics. A must-listen for anyone tracking where the real value in AI is moving. #AIInference #ComputeBottleneck #NVIDIA #AMD #TokenEconomics #AIAgents #LargeLanguageModels #GenerativeAI #Technology #TechStocks #AIInfrastructure #ChipDesign #CloudEconomics #DataCenters #FexingoBusiness #BusinessPodcast #ChatGPTandBeyond #ProductivityTools Keep every episode free: buymeacoffee.com/fexingo

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

• Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysisTraining Data · on Nvidia95 / 100
• Where's the Smart Money Going in AI? Rob May, Co-Founder & CEO of NeuroMetric AI, on Inference, ROI, and the Bets That MatterMaking Data Simple · on Nvidia91 / 100
• #63 - The Fool: David Gardner explains his philosophy of buying stocks at high valuations after they have gone up a lotBehind the Balance Sheet · on Nvidia87 / 100
• AI CEO Series: Dr. Varun SivaramNext in Tech · on Nvidia86 / 100
• Yuval Ariav, Solo GP of Symbol Capital, on Pre-Consensus Investing, Why NextSilicon Could Be Israel's NVIDIA, and the $1.1 Trillion Market Hiding in Plain SightInvested by Aleph · on Nvidia86 / 100
• From Amazon to Arm: The Blueprint for Scaling Tech Giants with Jason ChildSecrets of Rockstar CFOs · on Nvidia85 / 100

• Why AI Companies Are Buying Presentation Software74 / 100
• Why AI Agent Browsers Are the Next Platform War
• The Hidden Cost of Free AI Tools
• How AI Coding Agents Are Redefining Developer Productivity
• Why Open-Weight AI Models Are Closing the Gap