Using AI at Work

Coleman delivers substantial, non-obvious frameworks throughout - particularly the 'five deadly sins' of pilot purgatory and the distinction between replacing jobs vs. augmenting experts. However, the episode includes moderate throat-clearing, repetition of concepts (expertise in heads, job shadowing analogy), and some padding around platform diversification that dilutes density.

“The biggest problem is the judgment, the context that AI needs lives in people's heads. So John and Susie cannot be downloaded into AI.”

“If you need to give feedback on everything they do, you should fire the agent. Now, if you only need to spot check or for the things that are high risk, those are the things you need to review, then great.”

Coleman presents relatively fresh frameworks (five deadly sins, job-shadowing-as-model for AI agents, radiologist analogy) but relies heavily on well-circulated ideas (problem-first thinking, ROI measurement, integration importance). The radiologist comparison is effective but not novel in AI discourse. Limited contrarian positioning beyond divergence from 'single brain' concept.

“Your early question, it's how to think about the business outcome. Yeah. And this is the hardest thing for leaders at all levels to think about how do I put a number of ROI to success?”

“I disagree about the single brain stuff. I think that's a lot of it is marketing uh like AGI kind of futuristic talk.”

Coleman brings legitimate operating experience - three-time founder, enterprise AI/regulated industry focus, direct client work at Fortune 100 companies. His credibility is grounded in practice rather than theory. However, he presents himself as YPO member and consultant rather than operating executive at scale, and references previous marketplace business rather than deep trenches in AI operations personally.

“What qualifies me, I think BattleScars a little bit, uh, as you mentioned, it's my third tech company, but it's mainly been focused on enterprises and regulated enterprises.”

“I've been in this since you know mobile was hot back in 2013.”

Coleman references specific Fortune companies (Nestle, Kenview, Danone, Meta), real-world examples (friend's billion-dollar company losing value, radiologist workflow), and concrete context-window numbers (million tokens = three Harry Potter books). However, he avoids quantifying most claims - no specific ROI numbers shared, no actual pilot success rates disclosed, and case studies mentioned without detail or data.

“I give you case studies from my other customers, like, okay, Nestle did this or Kenview did this, or Danone did this. Here's how we saved X.”

“a friend of mine that built a billion-dollar company on Meta's ads because they were cheap early on, those ads 10x in price, his company went down to nothing over a year”

Host Nagel asks solid opening questions and occasionally probes (e.g., on capturing expert judgment, trust levels), but rarely presses back on claims or explores contradictions. Nagel validates frequently ('So really good stuff') rather than challenge. Coleman largely controls the narrative without rigorous follow-up on specifics like the Gartner/Wharton studies mentioned or the actual five deadly sins prioritization beyond assertion.

“So outside of that, um, how can a company capture this expert judgment without creating another like massive documentation project”

“So for the listener, especially if you're uh introducing AI into the organization, you're leading it, that's a really good distinction there”