AI Won't Replace Engineers, But This Framework Will Change How They Build with Rohit Girme

Episode notes

Scaling AI from proof-of-concept to production requires more than just deploying models; it demands robust evaluation frameworks, human oversight, and a fundamental shift in how engineering teams approach development. In this episode of The Data Engineering Show, host Benjamin Wagner sits down with Rohit Girme , Staff Software Engineer at Airbnb, to explore how Airbnb built a Gen AI evaluation platform to assess LLM outputs across product surfaces, from customer support bots to search and booking experiences. Rohit shares insights into Airbnb's infrastructure choices, evaluation workflows, and lessons learned about leveraging AI tools while maintaining human orchestration.

• AI for Data and Data for AI: The Dual Frontier of Modern Data Engineering with Pranav Motarwar55 / 100
• The Framework Canva Uses for 200M+ Designers with Paul Tune
• Llama 2 & 3 Safety: Soumya Batra on Agentic AI Training
• The Data Fusion Secret & Why Custom Query Engines Fail with Nikita Lapkov
• How Zipline AI Turns Weeks of Engineering Into Minutes of SQL Queries ft. Nikhil Simha