Evals, Feedback Loops, and the Engineering That Makes AI Work

Episode notes

Martin Casado speaks with Ankur Goyal, founder and CEO of Braintrust, about where engineering actually matters in AI and where it doesn't. They cover the open source vs closed source model cycle, why Chinese models are gaining ground faster than spending suggests, whether AI demand will eventually saturate, and the Bash vs SQL benchmark that challenges the "just give it a computer" approach to agents. Follow Martin Casado on X: Follow Ankur Goyal on X: Check out everything a16z is doing with artificial intelligence here , including articles, projects, and more podcasts. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

• How AI Is Rewriting the Rules of Cybersecurity | Truffle Security & Socket95 / 100
• Building Self-Accelerating AI with Mirendil65 / 100
• Inside vLLM: The Engine Powering Open-Source AI
• Ideogram’s Open-Weights Image Model and the Future of AI Design
• Building Search for AI Agents with Exa CEO Will Bryk