Enterprise Tech with Fexingo · 2026-07-18 · 11 min
Episode 119 of Enterprise Tech with Fexingo. Lucas and Luna dive into a new front in enterprise software procurement: benchmark clauses for vendor AI models. They unpack a real negotiation between a Global 50 bank and a cloud AI provider over how to define, test, and enforce model performance - covering test set specifications, third-party auditors like MLCommons, and the gotcha of 'cheating' on static benchmarks. Lucas explains why GPU reservation costs make vendors fight harder on this than on traditional SLAs, and why the procurement team's secret weapon is asking for a custom holdout set. If you're on either side of a large-scale AI software deal, this one's for you. #AI #Benchmarks #EnterpriseSoftware #Fortune500 #Procurement #VendorManagement #ModelPerformance #MLCommons #SLAs #CloudNegotiation #GPUCosts #Business #Technology #FexingoBusiness #BusinessPodcast #EnterpriseTech #SoftwareContracts #AIProcurement Keep every episode free: buymeacoffee.com/fexingo
How Fortune 500s Protect Against SaaS Vendor Failure with Escrow81 / 100Why Fortune 500s Now Demand AI Model Red-Teaming90 / 100How Fortune 500s Negotiate Vendor AI Hallucination Insurance88 / 100How Fortune 500s Use Procurement to Negotiate Vendor Software Liability Caps92 / 100How Fortune 500s Negotiate Software Beta Test Terms90 / 100