Enterprise Tech with Fexingo · 2026-07-21 · 10 min
Episode 124 of Enterprise Tech with Fexingo dives into a rapidly emerging clause in enterprise software contracts: AI model explainability. Lucas and Luna unpack why Fortune 500 procurement teams - from a major insurer to a Fortune 50 bank - are now demanding the right to audit how vendor AI models reach decisions. They discuss the specific contractual language around 'meaningful explanations,' the tension between trade secrets and regulatory compliance, and how this is reshaping vendor relationships. Lucas shares a real case where a retailer walked away from a deal because the vendor couldn't explain why its pricing model flagged certain suppliers. Luna raises the practical challenge: can explainability even work for deep learning models without huge engineering overhead? The episode ends with a look at what this means for the next generation of enterprise AI procurement.