How AI Models Are Splitting Into Reasoning and Retrieval

Episode notes

Episode 100 of ChatGPT and Beyond with Fexingo marks a milestone by exploring the quiet structural split happening inside today's large language models: the separation of reasoning from knowledge retrieval. Lucas and Luna break down why companies like NVIDIA and ARM are seeing divergent stock moves tied to this architectural shift, and how a new generation of 'hybrid RAG' systems is changing enterprise AI deployment. They discuss a specific case - a mid-sized logistics firm that cut inference costs by 40 percent by separating its model's reasoning and retrieval layers - and what that means for the broader AI stack. With live market data from July 9, 2026, the episode connects the dots between falling model costs, rising inference demand, and the companies positioned to win in a world where intelligence and memory are no longer bundled together. #AI #LargeLanguageModels #Reasoning #Retrieval #RAG #EnterpriseAI #NVIDIA #ARM #SMCI #AIInference #ModelArchitecture #HybridAI #AICosts #TechInvesting #GenerativeAI #Technology #FexingoBusiness #BusinessPodcast Keep every episode free: buymeacoffee.com/fexingo

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

• Rumman Chowdhury (Humane Intelligence): The Need for DiscernmentThe Road to Accountable AI · on Enterprise AI deployment90 / 100
• The AI Maximalist Playbook: James Raybould on Building at the Speed of IdeasAI for Business Leaders · on Enterprise AI deployment65 / 100
• Why AI ARR Alone No Longer Lifts Your Software ValuationSaaS Metrics School · on Inference costs52 / 100
• OpenAI Partner Network Signals New Era of Enterprise AI DeploymentCloud Wars Live with Bob Evans · on Enterprise AI deployment35 / 100
• Microsoft Work Trends Index 2025 SummaryIT Sourcing Sorcerer · on Enterprise AI deployment35 / 100

• Why AI Companies Are Buying Presentation Software74 / 100
• Why Palantir Stock Is Surging While AI Peers Decline72 / 100
• How AI Model Marketplaces Are Becoming the New Operating Systems68 / 100
• Why AI Model Marketplaces Are Becoming the New Operating Systems70 / 100
• Neoclouds Are the New AI Infrastructure Battlefield72 / 100