Unsupervised Learning with Jacob Effron · 2026-05-22 · 60 min
Oriol Vinyals, VP of Research at Google DeepMind and co-lead of the Gemini program, joins Jacob the day after Google I/O to unpack the research underpinning Google's latest announcements and where frontier AI is heading. The conversation moves from world models (why Google has uniquely bet on them as a path to AGI, what the "GPT moment" for video and images would look like, and how they connect to robotics and simulation) to agents (the Spark release, why the system and model need to be optimized jointly, and why scaffolding will eventually be written by models themselves). Oriol gets into the mechanics of memory in models, drawing on his cognitive neuroscience background to argue that file-system-style non-parametric memory is more practical than baking memory into weights at serving scale. He shares his views on the limits of RL today (LLMs are data-limited in a way that game-playing RL never was), why training on narrow domains like math and code generalizes surprisingly well, and what a true "Move 37" moment for science or ML research would look like.
Ep 90: AI Pioneer Jürgen Schmidhuber on the State of AI Today85 / 100AI Vibe Check: Lab Wars, Why APIs Might Vanish & Future Predictions73 / 100Ep 89: AI Research Legend’s Honest Assessment of Where We Are80 / 100Ep 88: Unpacking DeepMind's Quest for SuperIntelligence with Demis Hassabis' Biographer82 / 100Ep 86: Yann LeCun on Leaving Meta, Breaking The LLM Paradigm, & Why Hinton is Wrong