The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/Customer Success/The Customer Success Playbook
The Customer Success Playbook artwork

Customer Success Playbook Podcast S3 E63 - AI Revolution in Customer Success: From Chorus to Custom GPTs

The Customer Success Playbook · 2025-06-08 · 12 min

0:00--:--

Key moments - from our scoring

Substance score

35 / 100

Five dimensions, 20 points each

Insight Density7 / 20
Originality5 / 20
Guest Caliber9 / 20
Specificity & Evidence8 / 20
Conversational Craft6 / 20

John Humer, who recently launched Customer Success Architects, shares how AI is reshaping customer success operations beyond the hype. He walks through his hands-on experience implementing Chorus AI - an AI notetaker that enabled him to coach a 35-person team and quickly understand customer context before meetings - and his current focus on newer purpose-built CS tools like Sturdy. Sturdy aggregates unstructured data from email, Slack, support tickets, and CRM to surface churn risk early through large language models, something Humer wishes he'd had during his last operator role. The conversation highlights how unstructured data analysis, combined with tools like Gong for call recording, allows teams to reclassify churn reasons and identify expansion opportunities that CSMs might miss. For B2B operators building CS functions, the episode clarifies that AI's real value lies in efficiency and data synthesis - not replacement - and offers concrete next steps like custom GPTs for renewal pricing workflows.

Key takeaways

  • →Chorus AI and similar call recording tools enable CSM coaching at scale and provide context before customer meetings without requiring manual note-taking.
  • →Sturdy and similar AI platforms can surface early churn risk and expansion opportunities by analyzing unstructured communication data across email, Slack, support tickets, and CRM.
  • →Reclassifying churn reasons through AI-powered analysis of historical call data often reveals significantly different actual churn drivers than teams initially thought.
  • →Custom GPTs trained on pricing strategy and policies can support CSMs in renewal negotiations by providing pricing options alongside benefits and upsell recommendations.
  • →CSM adoption of AI tools has been high once they realize efficiency gains; the real risk is to teams that don't adopt, not to those displaced by automation.

In this episode

  1. 1Chorus AI as a CS Coaching and Call Analysis Tool
  2. 2Emerging AI Platforms: Sturdy for Risk Identification
  3. 3Using Unstructured Data to Reclassify Churn and Identify Expansion Opportunities
  4. 4CSM Adoption and Benefits of AI Implementation
  5. 5Favorite AI Tools and the Myth of CSM Replacement
  6. 6Custom GPT for Renewal Pricing and Deal Support

Mentioned

Chorus AISturdyGongChatGPTKevin MetzgerJohn HumerCustomer Success Architects

Guests

John Humer

Topics in this episode

GongCustomer health scoringChurn predictionCustom GPTsCall recording and transcriptionNet retention optimizationUnstructured data analysisConversation intelligenceAI customer successChorus AISturdyRenewal pricing workflowsChurn risk identification

Questions this episode answers

What is Sturdy and how does it work for customer success?

Sturdy is an AI platform purpose-built for customer success that aggregates unstructured data from email, Slack, support tickets, and CRM data, then runs it through a large language model to identify churn risk early and surface expansion opportunities.

How did John Humer use Chorus AI to manage a large CS team?

With a 35-person team across CSMs and account executives, Humer used Chorus AI's recordings to coach staff remotely and quickly understand customer context and sentiment before meetings without being able to join every call himself.

What is the most overhyped myth about AI in customer success?

The myth that AI will replace CSMs is unfounded; AI enables CSMs to do more by automating tasks and providing insights, but the human-to-human connection remains essential.

What custom GPT experiment is John Humer planning to explore?

A custom GPT trained on pricing strategy and policy that allows CSMs to input customer and product data to generate renewal pricing options along with accompanying benefits and upsell recommendations.

How can companies get started with AI in customer success?

Start with foundational tools like call recording and transcription, then identify a specific use case with clear ROI, implement it, and expand from there rather than trying to boil the ocean.

What our scoring noted

Our reviewer’s read on each dimension, with quotes from the episode.

Insight Density

7 / 20

The episode surfaces a couple of named tools (Chorus, Sturdy) and one concrete use case (custom GPT for renewal pricing), but the majority of airtime is spent on generic observations and platitudes. The host's interjections add almost no incremental insight.

The general guidance from an AI perspective is start small, find a use case that provides some kind of return that makes sense to do. Try that and then make a decision about what you do next.
they take all of the unstructured data that you communicate with your customers, such as email, um, Slack channels, support tickets, CRM data, and they take and aggregate that data and run it through their large language model. To identify risk and risk early on.

Originality

5 / 20

The episode leans heavily on well-worn takes - AI won't replace humans, start small, break down data silos - with almost no contrarian or first-principles reasoning. The renewal pricing GPT anecdote is the sole genuinely fresh idea, and even that is attributed to an unnamed third party without meaningful exploration.

I think this is easy. I think uh, this myth that AI is going to replace the CSM is silly. There's still that human to human connection that I think is required.
it's going to break down all of those silos of data, uh, you know, that we've been talking about for years

Guest Caliber

9 / 20

John is a genuine CS practitioner who ran a 35-person team and has recently launched a consultancy, giving him real operator credibility. However, there is no indication of scale, marquee employer, or verifiable outcomes that would distinguish him from many mid-market CS leaders.

at that point I had roughly 35 people on my team across, uh, CSMs and account executives
as I launched Customer Success Architects earlier this year, I spent a lot of time really trying to re educate and reorient myself with the technology

Specificity & Evidence

8 / 20

The guest names specific tools (Chorus, Sturdy, GONG) and sketches a concrete GPT use case with example inputs, which is above average for a short episode. However, there are zero hard metrics - no churn percentages, retention lift, time saved, or dollar figures - keeping the score solidly mid-range.

they take all of the unstructured data that you communicate with your customers, such as email, um, Slack channels, support tickets, CRM data
a CSM could go in and say customer ABC is interested in a three year and a five year renewal term. Um, help me derive pricing for it and you know, you can enter in user data and product data

Conversational Craft

6 / 20

The host asks mostly surface-level, leading questions and frequently answers them himself with lengthy monologues, crowding out follow-up depth. There is no pushback, no probing of claims, and the lightning round is entirely softball - emblematic of a promotional chat rather than rigorous inquiry.

So what's your favorite AI tool round right now?
Have you had any pushback from CSMs or seen anything where you've got people who are concerned about what it's doing?

Conversation analysis

Computed from the transcript - who did the talking, and the words that came up most.

Share of words spoken

  • Speaker B50%
  • Speaker A50%

Most-used words

customer22data12back9success8case7quickly7pricing7starting6john5tool5churn5cool5happy4perspective4csms4calls4

Episode notes

Send us Fan Mail AI Friday delivers cutting-edge insights as John Huber reveals how artificial intelligence is transforming customer success operations. The conversation explores practical AI applications that are already delivering results, from conversation intelligence tools like Chorus for team coaching and customer context gathering, to emerging platforms like Sturdy that analyze unstructured data across email, Slack, and support tickets to identify churn risks and expansion opportunities. John challenges the overhyped notion that AI will replace CSMs, emphasizing instead how it amplifies human capabilities and enables more strategic engagement. The discussion culminates with an intriguing experiment: using custom GPTs for renewal pricing strategy that combines deal structure recommendations with benefit articulation. This customer success playbook episode demonstrates how forward-thinking CS leaders are leveraging AI to scale their impact while maintaining the human connections that drive customer loyalty.

Full transcript

12 min

Transcribed and scored by The B2B Podcast Index.

Speaker A: They got the game Customer successes that claim to fame. Happy Friday everyone. I'm Kevin Metzger without my co host Roman. Our guest John Humer. We've already talked about John's number one tip for building a CS function and debated who should own expansion. Today we're zoning in on AI, uh, specifically how John has started using AI as a customer success leader. John, we're super excited AI Friday. We always love talking about AI. It's where we're at these days. Everybody's starting to look at how to use it best use cases and so I think I want to start there. What's your best use case for AI and customer success right now?

Speaker B: Well, happy Friday and uh, excited to uh, jump into this topic. I think there's a couple, I'll go back probably a few years and we implemented a tool called Chorus AI, which is an AI notetaker. And I quickly learned how valuable of a tool it was. And really from a coaching perspective, at that point I had roughly 35 people on my team across, uh, CSMs and account executives. And I couldn't physically join all of the customer calls and internal calls. So to be able to go and not only listen to the recordings but also, you know, have it as a tool to be able to coach, uh, the team, uh, you know, on a periodic basis. But where I also found it really valuable was I could jump into a recording ahead of meeting with a customer and really understand where are we at in the customer journey with this, uh, with this customer, what's the context of the conversation? Are they a happy customer? Are they a not so happy customer? And be able to get that before you walk into a meeting or an on site with a customer was hugely valuable. I think that's one example. You know, another example more recently, as I launched Customer Success Architects earlier this year, I spent a lot of time really trying to re educate and reorient myself with the technology. Your traditional customer success platforms, a lot of those organizations are looking at different ways to incorporate AI into their platform from health scoring, from engagement opportunities with customers. But what I found is there's a whole host of new companies that are starting to emerge that are built on AI and focused on that. And I think one that has really caught my eye is a company called Sturdy. And what they do is their purpose built for customer success. They take all of the unstructured data that you communicate with your customers, such as email, um, Slack channels, support tickets, CRM data, and they take and aggregate that data and run it through their large language model. To identify risk and risk early on. And I'll be honest Kevin, this is a tool I wish I had when I was an operator last year getting ready for customer health and CHURN meetings. So it's pretty cool to see how quickly the technology evolves.

Speaker A: That's pretty cool. I actually haven't heard of Sturdy yet so that's the first time I'm going to have to check that one out. That's definitely one of the areas where I'm starting to hear more and more as the primary use case is looking at real churn reasons and uh, uh, sat in the local in Atlanta. There's Atlanta customer Success and we had our monthly meeting I think it was last week. Yeah it was last week actually. Former guest was on or was speaking uh, at that meeting but talking about the exact same use case. They developed their own process but for doing it they weren't using ah, Sturdy but um, went back through all of the, they had GONG in place and they went through, back through all of the calls for GONG calls and started looking for basically did a reclassification of Churn risks and reasons for Churn and were able to really kind of do a uh, much more detailed analysis of why customers were churning and really actually was able to see some significant changes from what they thought it was uh, versus the updated analysis. When you're really able to look at that unstructured data um, and capture the actual reasons when you go back looking through it.

Speaker B: Absolutely. And I think too what's also really interesting about those types of platforms, not only to be able to identify risk early on in those hearing kind of conversationally from your customer but also starting to identify opportunities on the other side of it, boosting net retention and seeing opportunities for cross sell and expansion, you know, within your customer base as well. So it's fascinating how quickly this technology

Speaker A: is moving and it's really interesting because every use case you kind of get and refine, companies are trying to figure out okay, where do I apply, where do I spend money? The general guidance from an AI perspective is start small, find a use case that provides some kind of return that makes sense to do. Try that and then make a decision about what you do next. Coming up with each of these individual types of use cases, whether if you're not already using it, uh, to do transcription, recording and all that, you're definitely as a company you're definitely behind.

Speaker B: Right?

Speaker A: I mean those are, that's kind of a fundamental thing. But once you start capturing that data and really having all of that data now you can really, the tools are there and the implementation process is available. It takes some time, it takes some effort. You got to figure out what you want to achieve with it. But you can reclassify all your churn cases and actually figure out where what, what, where your indicators are, what your early indicators are. You can really figure out what, hey, this customer, these customers are talking about this need they have, and, and our CSMs haven't identified it, but we realize it's a need because, look, you can have the AI, uh, go back and look across all the conversations, and now you've got, uh, product updates, you've got expansion opportunities. I mean, all of the information that has been tapped is, or as you, if you capture it, you can then now tap it. And, um, you can tap it with intelligence that's able to look across all of the data in a way that you just never could before. It's amazing.

Speaker B: Yeah, it really is. And I think it's, you know, it's going to break down all of those silos of data, uh, you know, that we've been talking about for years, and you'll be able to tie all that data together, especially the unstructured data.

Speaker A: So it's exciting as you walk through this and see this and as we identify these, obviously. Have you had any pushback from CSMs or seen anything where you've got people who are concerned about what it's doing?

Speaker B: Not really. When we did implement chorus, there was a little hesitation, but I think when CSMs quickly realized how much more efficient they could be, where they could automate the task or capture recordings, versus trying to take notes and have a conversation with the customer at the same time. You know, everybody was quickly on board. And I think those that aren't willing to adopt or embrace AI and AI platforms, they're going to quickly get left behind, unfortunately. But I think most are quickly starting to realize the benefits.

Speaker A: I had put in a little kind of lightning round this week. I'm not sure if you maybe answered one of the questions already, but we'll go ahead and give it a shot anyway. Uh, so what's your favorite AI tool round right now?

Speaker B: I would say sturdy from an enterprise perspective. And then I'm a chatgpt guy, so I use that, uh, daily, personally and for work.

Speaker A: So do you use the subscription or do you use free model?

Speaker B: I, uh, use the free model right now. So I've been kind of pushing that, uh, but I'm close to pulling the trigger on the subscription.

Speaker A: Subscription, yeah.

Speaker B: Cool. All right.

Speaker A: Most Overhyped AI myth in customer success.

Speaker B: I think this is easy. I think uh, this myth that AI is going to replace the CSM is silly. There's still that human to human connection that I think is required. I think AI is going to allow us to do more. But uh, I don't think you're ever going to replace the human element.

Speaker A: And what's the next AI experiment on your roadmap?

Speaker B: So this is an interesting one. I heard this on a, um, on a webinar about two months ago and it really piqued my curiosity. So um, the premise is somebody built a custom GPT to support all of their renewal pricing. So to align with kind of their pricing strategy and their pricing policy. And so a CSM could go in and say customer ABC is interested in a three year and a five year renewal term. Um, help me derive pricing for it and you know, you can enter in user data and product data and just as you know our deal desk or a pricing, you know, um, calculator would you know, provide those answers back. It would provide it back but also provide it back with you know, benefits on why um, you know, that go along with that renewal. So I just, I found it fascinating that people are starting to build these and train these models for you know, things like renewal pricing. I think that would be a really interesting uh, you know, perspective to, to explore.

Speaker A: That actually sounds like a pretty cool, um, pretty cool use case. I, I like the idea and especially with the idea that you can kind of help return not just the model but hey, here's the benefits, here's the upsell package, basically delivering broader than just the pricing but the full package benefits, how you deliver it all that probably can really get uh, wrapped in. It's a good use case. Jake, thank you for your time and really appreciate all your insights on how you're using AI. That wraps up our three part series with uh, John Huber. Connect with him on LinkedIn at www.LinkedIn.com in johnmhuber. M h u B E R if today's episode sparks ideas hit subscribe, leave a 5 star review and share the Customer Success Playbook podcast with a colleague. We'll be back next week with fresh tactics to elevate your CS game. Until then, keep on um, playing.

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

  • 127. AI Won't Replace You as a CSM (But It Does Raise the Bar) - with Dan Ennis!Customer Success Career Coach, Career Tips and Proven Job Interview Strategies For Every Customer Success Manager · on Gong95 / 100
  • Agentic AI in Sales: What Business Leaders Need to KnowScaling with AI · on Conversation intelligence86 / 100
  • How B2B Brands Use AI for Sales Call AnalysisThe Growth Operator with Fexingo · on Gong86 / 100
  • Go Bold with Competition Like a Sybill PMMProduct Marketing Adventures · on Gong82 / 100
  • Pax8 Roadshow Special - Ryan SigouinPartnerships Unraveled · on Customer health scoring80 / 100
  • 297 | From Prompt to Powerful: The Secret Formula Behind High-Impact AI Videos with Eve WhitakerLeveraging AI · on Custom GPTs80 / 100

More from The Customer Success Playbook

All episodes →
  • Customer Success Playbook - Final Episode with Kevin and Roman31 / 100
  • Customer Success Playbook Podcast S3 E72 - Adrian Swinscoe - Enhancing Customer Experience with AI55 / 100
  • Customer Success Playbook Podcast S3 E71 - Adrian Swinscoe - Unlocking Value in Customer Journeys48 / 100
  • Customer Success Playbook Podcast S3 E70 - Adrian Swinscoe - Data and Customer Storytelling74 / 100
  • Customer Success Playbook S3 E69 - Gayle Gorvett - Scaling AI Governance Without Killing Innovation65 / 100
Explore the best B2B Customer Success podcasts →
All The Customer Success Playbook episodes →