
The MAD Podcast with Matt Turck · 2026-06-04 · 49 min
Are we witnessing the first real signs of AI becoming a scientist? In this episode of The MAD Podcast, Matt Turck sits down with Dan Roberts, lead of the Foundations of Reinforcement Learning team at OpenAI, to explore one of the biggest shifts happening in AI: the rise of reasoning models, test-time compute, and reinforcement learning as engines of scientific discovery. Dan brings a rare perspective - from theoretical physics, black holes, quantum information, and deep learning theory - to explain how models are learning to “think,” why language may be such a powerful foundation for intelligence, what recent AI math breakthroughs really mean, and whether we are beginning to see AI systems that can contribute to science itself. (00:00) Intro: AI's wild week in mathematics (01:21) What OpenAI's Foundations of RL team does (03:08) Dan's journey: from black holes and quantum gravity to frontier AI (07:04) Are AI systems becoming useful for real science? (08:21) The AI math moment: Erdős, OpenAI, DeepMind, and Anthropic (08:52) Why the OpenAI result was an act of exploration (10:25) OpenAI vs. DeepMind: informal reasoning vs.