The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/AI & Data/How I AI
How I AI artwork

How Braintrust uses AI agents, evals, and CI to ship better software | Ankur Goyal

How I AI · 2026-06-15 · 40 min

0:00--:--

Episode notes

In this episode, I sit down with Ankur Goyal , founder and CEO of Braintrust, the AI evals and observability platform used by teams like Notion, Stripe, Vercel, and Zapier. This one is for the senior engineers, staff engineers, VPs of engineering, and CTOs in my audience. We get into how coding agents can take on deeply technical architecture and infrastructure work that no single human engineer could tackle before, and then we demystify evals so you can use them to make your AI products better without touching the implementation. What you’ll learn: How Ankur uses Codex to run week-long benchmark experiments across database indexes, column store formats, and execution engines to speed up slow queries Why he argues there’s no excuse to skip rigorous benchmarking now that agents can run them tirelessly The “agent line” framework: how to decide which decisions, directions, and interactions you can hand off to an agent How I think about the practical vs.

More from How I AI

All episodes →
  • Sonnet 5 review: I ran 64 generations to find out if it's worth it53 / 100
  • No Figma. No Jira. No docs. How Gusto built a new product line with Claude Code | Eddie Kim (CTO)
  • GLM 5.2: why I’m replacing Opus in Claude Code with this new model
  • How Claude Mythos found a 15-year-old bug in Mozilla Firefox | Brian Grinstead
  • How to design AI agent loops: schedules, goals, and subagents in Claude Code and Codex
Explore the best B2B AI & Data podcasts →
All How I AI episodes →