Inferact: Building the Infrastructure That Runs Modern AI - LLMs - AI + a16z

Topics in this episode

LLMs AI infrastructure vLLM Inference inferact

Episode notes

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently. Follow Matt Bornstein on X: Follow Simon Mo on X: Follow Woosuk Kwon on X: Follow vLLM on X: Check out everything a16z is doing with artificial intelligence here , including articles, projects, and more podcasts. Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

More from AI + a16z

All episodes →

Explore the best B2B AI & Data podcasts →