← The Index

Topic

Speculative decoding

A guide to the best B2B podcast coverage of Speculative decoding - the shows and 2 episodes that go deepest, ranked by substance, not downloads.

Best shows on Speculative decoding

Best episodes on Speculative decoding

  1. Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysis

    Training Data · 2026-06-30

    95 / 100

    …Is it something that needs to be super, super fast, super low latency? Um, and I don't really care about the cost, so I make batch size very low and I use techniques like speculative decoding or multi token prediction heavily.…

  2. How Anthropic Cut Inference Costs by 40 Percent

    The CTO Podcast with Fexingo · 2026-08-29