How AI Models Are Splitting Into Reasoning and Retrieval

Episode notes

Episode 100 of ChatGPT and Beyond with Fexingo marks a milestone by exploring the quiet structural split happening inside today's large language models: the separation of reasoning from knowledge retrieval. Lucas and Luna break down why companies like NVIDIA and ARM are seeing divergent stock moves tied to this architectural shift, and how a new generation of 'hybrid RAG' systems is changing enterprise AI deployment. They discuss a specific case - a mid-sized logistics firm that cut inference costs by 40 percent by separating its model's reasoning and retrieval layers - and what that means for the broader AI stack. With live market data from July 9, 2026, the episode connects the dots between falling model costs, rising inference demand, and the companies positioned to win in a world where intelligence and memory are no longer bundled together. #AI #LargeLanguageModels #Reasoning #Retrieval #RAG #EnterpriseAI #NVIDIA #ARM #SMCI #AIInference #ModelArchitecture #HybridAI #AICosts #TechInvesting #GenerativeAI #Technology #FexingoBusiness #BusinessPodcast Keep every episode free: buymeacoffee.com/fexingo

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

• Rumman Chowdhury (Humane Intelligence): The Need for DiscernmentThe Road to Accountable AI · on Enterprise AI deployment90 / 100
• Inside Target’s approach to enterprise AI deployment with Sowmya PodilaThe Ecommerce Toolbox: AI in Retail · on Enterprise AI deployment79 / 100
• The AI Maximalist Playbook: James Raybould on Building at the Speed of IdeasAI for Business Leaders · on Enterprise AI deployment65 / 100
• Why AI ARR Alone No Longer Lifts Your Software ValuationSaaS Metrics School · on Inference costs52 / 100
• OpenAI Partner Network Signals New Era of Enterprise AI DeploymentCloud Wars Live with Bob Evans · on Enterprise AI deployment35 / 100
• Microsoft Work Trends Index 2025 SummaryIT Sourcing Sorcerer · on Enterprise AI deployment35 / 100

• Why AI Companies Are Buying Presentation Software74 / 100
• Why AI Agent Browsers Are the Next Platform War
• The Hidden Cost of Free AI Tools
• How AI Coding Agents Are Redefining Developer Productivity
• Why Open-Weight AI Models Are Closing the Gap