The B2B Podcast Index
Index
All categories
MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
MethodologySubmit
Best of:MarketingSalesSaaSFinanceHROpsLeadershipCustomer SuccessAI & DataProductStartups & FoundersRevOpsEngineering & DevTools
An independent project byFame
SearchBest episodesGuestsInsightsMethodologySubmit a podcast
Index/Engineering & DevTools/The Data Engineering Show
The Data Engineering Show artwork

The Data Fusion Secret & Why Custom Query Engines Fail with Nikita Lapkov

The Data Engineering Show · 2026-03-24 · 18 min

0:00--:--

Episode notes

In this episode of The Data Engineering Show, host Benjamin Wagner sits down with Nikita Lapkov , Senior Software Engineer at Cloudflare, to explore the architecture, design decisions, and future roadmap of R2 SQL- Cloudflare's new R2-based distributed query engine launched in September 2024. What You'll Learn: How to leverage existing query engines strategically : Why Cloudflare chose Apache Data Fusion for single-node query processing rather than building an analytical engine from scratch, freeing engineering resources for distributed orchestration challenges. The stateless architecture pattern for global infrastructure : How to design compute nodes that hold zero persistent state by storing all metadata in a distributed catalog (Iceberg), enabling per-query worker provisioning across 300+ geographically dispersed data centers. Why filter pushdown and metadata-driven pruning are non-negotiable optimizations : How to reduce data scanned from object storage before query execution begins by leveraging catalog statistics and range filtering - the foundation of R2 SQL's performance gains.

More from The Data Engineering Show

All episodes →
  • AI for Data and Data for AI: The Dual Frontier of Modern Data Engineering with Pranav Motarwar55 / 100
  • AI Won't Replace Engineers, But This Framework Will Change How They Build with Rohit Girme
  • The Framework Canva Uses for 200M+ Designers with Paul Tune
  • Llama 2 & 3 Safety: Soumya Batra on Agentic AI Training
  • How Zipline AI Turns Weeks of Engineering Into Minutes of SQL Queries ft. Nikhil Simha
Explore the best B2B Engineering & DevTools podcasts →
All The Data Engineering Show episodes →