Moving Beyond RAG with Precomputed Context

Episode notes

Retrieval has become one of the central problems in building useful AI systems. The standard approach to grounding a model in one's own data has been retrieval augmented generation, or RAG, where an agent searches a vector database for relevant information at query time. That pattern works, but it has limitations, such as retrieving information that's not truly relevant, repeating the same lookup work on every query, and producing inconsistent answers to the same question. Pinecone is a vector database that's widely used to power semantic search and RAG at scale. The team recently developed Nexus, which is a knowledge engine that reframes context as a first-class, precomputed asset rather than something reassembled on the fly. The approach borrows the database concept of a materialized view, and curates context once into a versioned artifact that carries its own schema, metadata, permissions, and lineage. Jörg Schad is the VP of Engineering at Pinecone. In this episode, he joins Kevin Ball for an in-depth conversation about the frontier of retrieval technology.

• Inside Google’s Database Infrastructure for the AI Era94 / 100
• The Terminal as an Agentic Interface87 / 100
• Eric Ries on Why Good Companies Go Bad92 / 100
• A Rust Framework to Simplify Distributed Systems
• SED News: The NVIDIA-Hugging Face Deal, China’s Proxy Economy, the Open Weight Surge