KubeFM · 2026-04-07 · 30 min
You're running gRPC services in Kubernetes, load balancing looks fine on the dashboard - but some pods are burning at 80% CPU while others sit idle, and adding more replicas only partially helps. Rohit Agrawal , a Staff Software Engineer on the traffic platform team at Databricks, explains why this happens and how his team replaced Kubernetes's default networking with a proxy-less, client-side load-balancing system built on the xDS protocol. In this episode: Why KubeProxy's Layer 4 routing breaks down under high-throughput gRPC: it picks a backend once per TCP connection, not per request How Databricks built an Endpoint Discovery Service (EDS) that watches Kubernetes directly and streams real-time pod metadata to every client How zone-aware spillover cut cross-availability-zone costs without sacrificing availability Why CPU-based routing failed (monitoring lag creates oscillation) and what signals to use instead The system has been running in production for three years across hundreds of services, handling millions of requests. Sponsor This episode is sponsored by LearnKube - get started on your Kubernetes journey through comprehensive online, in-person or remote training.
The Hidden Cost of Slow Autoscaling, with John Ford81 / 100The Namespaces Scaling Trap, with Brian StackAI Agents Running Kubernetes, with Mike SolomonSaaS with Kubernetes Operators and Garbage Collection, with Alexander HeldWhat Hip-Hop Can Teach Us About Kubernetes, with Kelsey Hightower, Eric Abercrombie, and Julius Payne II