The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
#30TestGuild Automation Podcast84.0 / 100Get badge
← The Index
TestGuild Automation Podcast artwork
Engineering & DevTools▲131 this period

TestGuild Automation Podcast

Hosted by Joe Colantonio

Listed under Technology, Education › How To

TestGuild Automation Podcast (formally Test Talks) is a weekly podcast hosted by Joe Colantonio, which geeks out on all things software test automation. TestGuild Automation covers news found in the testing space, reviews books about automation, and speaks with some of the thought leaders in the test automation field.

604 episodes · publishes weekly · latest 2026-08-04 · ~33 min/episode

Rank

#30

Substance

84.0

/ 100

Breakdown

Scored 2026-08
Updated monthly

Engineering & DevTools rank

#2 of 60

Best B2B Engineering & DevTools Podcasts →

Across the index

#30 of 1627

Substance

Top 2%

outscores 98% of the index

Why it scores where it does

TestGuild Automation Podcast ranks #30 on The B2B Podcast Index with a substance score of 84.0 out of 100, scored across 2 recent episodes. It scores highest on guest caliber and conversational craft. Knight is legitimately credible: a Senior Director of Product and Engineering with 3+ years full-time tenure, shipping major releases with a small team supercharged by AI tooling. He has real operational responsibility, isn't a career podcast guest, and speaks from hands-on experience shipping code and leading engineers. His claims are grounded in current practice, not theory. The depth of his Playwright and AI coding agent knowledge is authentic and demonstrated through multiple specific examples.

The five-dimension breakdown

Averaged across 2 recently scored episodes, with cited evidence.

Insight Density

16.5 / 20

The episode contains genuine insights about AI-driven testing and team management at scale, particularly around specification-driven development, token cost management, and the Playwright ecosystem evolution. However, significant portions are consumed by autobiographical tangents (Volkswagen collection, wife's dance studio, personal projects) that dilute substance. The core testing and AI coding insights are solid but interrupted by filler.

“markdown as the new programming language and the AI coding agent was just the new compiler”

“we use Speckit to make testing strategy into a product once, so it never has to be argued about again”

Originality

16.0 / 20

Knight offers some contrarian takes worth hearing - particularly the idea that code quality may matter less when AI is the 'compiler' and markdown the 'language,' and his assertion that business value trumps formatting standards. The framing of Playwright's evolution from testing tool to RPA/AI platform is useful. However, much of the discussion recycles familiar AI-era themes (AI as force multiplier, need for human review, specs before code) that are circulating widely in tech discourse.

“I see these AI coding tools as the new compiler. I see markdown as the new programming language”

“code quality may not matter the way you think it does anymore”

Guest Caliber

19.0 / 20

Knight is legitimately credible: a Senior Director of Product and Engineering with 3+ years full-time tenure, shipping major releases with a small team supercharged by AI tooling. He has real operational responsibility, isn't a career podcast guest, and speaks from hands-on experience shipping code and leading engineers. His claims are grounded in current practice, not theory. The depth of his Playwright and AI coding agent knowledge is authentic and demonstrated through multiple specific examples.

“three days from now is my three year anniversary as a full timer”

“my team of six, which includes me, we are the entirety of product and engineering”

Specificity & Evidence

15.5 / 20

The episode provides some concrete details: Speckit and Superpowers as tools, Playwright's three main agents (Planner, Generator, Healer), MCP vs. CLI trade-offs, team size (6 people including Knight), subscription costs ($20-25/month), and Q3 2026 release plans. However, most claims lack numbers: no metrics on velocity gains, no concrete examples of bugs caught by Speckit, vague cost discussion ('no runaway costs yet'), and the wife's dance studio example is more anecdotal color than evidence. Many assertions remain abstract (e.g., 'we got more stuff to do' without quantification).

“my team of five reports”

“roughly expected costs”

Conversational Craft

17.0 / 20

Joe conducts solid follow-up questions, particularly around quality assurance amid velocity ('how do you know shipping velocity is actual quality'), domain knowledge erosion, and the controversial code-quality claim. He pushes back productively on Knight's compiler analogy and AI slop tolerance. However, many questions are softball affirm-atives ('Love it') or redirect to new topics rather than drilling into tension. Joe doesn't challenge Knight's assertions hard enough - e.g., no pushback on the claim that 'code quality doesn't matter,' no skepticism on the token cost management, minimal interrogation of how Speckit actually prevents rework.

“how do you know what's really being produced by your people that report to you”

“But is that the wrong way to go? Like, if it's working, it's doing what I need, it's doing in a way that's fast enough. What do I care about what it looks like?”

Standout episodes

  • Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight

    2026-08-04

    86
  • Agentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat

    2026-07-07

    82

Rank over time

2 periods tracked.

Episodes

2 scored on substance · 65 tracked in total.

  • Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight

    2026-08-04 · 38 min

    86 / 100
  • Agentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat

    2026-07-07 · 44 min

    82 / 100

Frequently asked

What is TestGuild Automation Podcast's substance score?
TestGuild Automation Podcast scores 84.0 out of 100 for substance and ranks #30 on The B2B Podcast Index. That puts it ahead of 98% of the B2B podcasts we rank and #2 of 60 in Engineering & DevTools. The score reflects insight density, originality, guest caliber, specificity and conversational craft across recent episodes - not downloads.
Is TestGuild Automation Podcast worth listening to?
Yes - TestGuild Automation Podcast outscores 98% of the B2B engineering & devtools podcasts and shows we rank on substance, so a engineering & devtools operator is likely to come away with something useful.
Who hosts TestGuild Automation Podcast?
TestGuild Automation Podcast is hosted by Joe Colantonio.
How often does TestGuild Automation Podcast publish?
TestGuild Automation Podcast publishes weekly, has 604 episodes, released its most recent episode on 2026-08-04.
Which TestGuild Automation Podcast episode should I start with?
Our highest-scoring recent episode is "Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight" (86/100) - a good place to start.

Show off your #2 rank in Engineering & DevTools

Add this badge to your site - it links back here and updates automatically as you rank.

Ranked #2 on The B2B Podcast Index
Embed code
<a href="https://index.fame.so/show/testguild-automation-podcast" target="_blank" rel="noopener">
  <img src="https://index.fame.so/badge/testguild-automation-podcast/badge.svg" alt="Ranked #2 on The B2B Podcast Index" width="360" height="136" />
</a>
Markdown & other formats →

Track TestGuild Automation Podcast's rank

Get an email whenever this show moves up or down the Index. Monthly at most, no spam.

Listen / subscribe:WebsiteSpotifyRSS

Guests who've appeared

Andrew KnightAmit Rawat

Topics this show covers

The themes that come up most across this show's episodes.

Claude · 2Playwright · 2CursorMCP ServerSpecKitSuperpowers toolkitPlanner generatorHealer agentsGherkin syntaxRisk-based testingOpenAILoop engineeringAgentic engineeringPrompt WriteGitHub Copilot SDKMoonshot (AI model)Chrome DevTools Protocol (CDP)Electron (desktop applications)

More Engineering & DevTools podcasts

See all →
  • DevOps Daily with Fexingo

    Fexingo

    89.0
  • Talos Takes

    Cisco Talos

    82.6
  • The Pragmatic Engineer

    Gergely Orosz

    82.2
  • RunAs Radio

    Richard Campbell

    81.5
  • Unsupervised Learning with Jacob Effron

    by Redpoint Ventures

    81.4
  • Ship It Weekly

    Teller's Tech - DevOps, SRE and Cloud Podcast

    81.2

Similar shows

Podcasts that dig into the same topics.

  • The AI Native Dev

    Tessl

  • Masters of Automation

    Alp Uguray

    81.6
  • Unsupervised Learning with Jacob Effron

    by Redpoint Ventures

    81.4
  • Hidden Layers

    KUNGFU.AI

    77.8
  • SAAS Operators

    SAAS Operators

    74.2
  • AI Across The Product Lifecycle Podcast

    Michael Finocchiaro

    70.8