Law Practice Today

The episode runs 14 minutes but delivers almost no ideas that a legally-aware B2B operator or legal professional wouldn't already know by 2024. The discussion stays at the surface - 'check your citations,' 'understand AI limitations,' 'follow ABA rules' - with no novel frameworks or non-obvious claims.

“why does this keep happening? What's the, um. By now everybody knows that this is a flaw in how these large language models work.”

“It could be laziness, it could be confusion. It could be a failure to understand the limitations of the tools.”

The episode recycles the most well-worn takes on AI hallucinations in legal practice - the Mata case, ABA competency rules, 'check your citations.' The only mildly fresh observation is using non-AI tools to verify AI outputs, but even that is barely developed.

“Should not be checking AI with AI.”

“you can at least start to predict when a hallucination might occur, and that occurs when you ask it. Something novel”

Jennifer Ellis has 27 years of litigation experience and speaks with genuine practitioner credibility; Michael Eisenberg is a legal tech commentator with a podcast. Neither is a high-profile operator who has managed AI risk at scale, and the fireside-chat context at a conference limits depth.

“I've been a lawyer for 27 years now”

“Michael, you're a student of all this. I know and have written about it and I have a podcast about it.”

The episode names Sullivan & Cromwell, the Mata case, ABA rules 1.1, 5.1, 5.3 and comment 8, and specific tools (Lexis, Westlaw, Google Scholar, Perplexity). However, critical details about the Sullivan & Cromwell filing - case name, court, outcome, specific citations - are absent, and there are no data, timelines, or dollar figures.

“you're violating simple ABA rules like 1.1 and comment 8”

“supervising whoever we're using. When I say whoever, it's either a clerk under 5.1 or a computer or an AI under 5.3”

The host earns some credit for one genuine pushback - challenging whether realistic workflows actually allow checking every citation - which produces a productive brief disagreement. However, most questions are open and soft, follow-ups don't press for specifics, and the conversation dissolves without resolution.

“I want to, uh, push back a little bit on what you said, Michael, because, uh, part of the problem here is what you're talking about, the obligations you're talking about really upends our work processes”

“But I disagree with you just a little bit”