Check in on AI: The true measure of success for AI initiatives
Content Operations · 2026-02-16 · 32 min
Episode notes
In this episode, Sarah O’Keefe and Alan Pringle explore how AI transforms content delivery from static documents into dynamic, consumer-driven experiences. However, the need for human-led governance is critical, and Sarah and Alan explore issues of accuracy, accountability, governance, and more. They challenge organizations to define AI success by its ability to deliver accurate, high-impact outcomes for the end user. Sarah O’Keefe: The metrics that are being used to measure the success of AI are all wrong. We should be measuring the success of various AI efforts based on, "Are people getting what they need? Are they having a successful outcome with whatever it is that they're trying to do?" The metric we actually seem to be using is, "What percentage of your workflow is using AI? How many people can we get rid of because we're automating everything with AI?” It's the wrong metric. The question is, how good are the outcomes? Related links: Sarah O’Keefe: AI and content: Avoiding disaster Sarah O’Keefe: AI and accountability Alan Pringle: Structured content: a backbone for AI success Questions for Sarah and Alan?