The Data Flowcast · 2026-05-21 · 26 min
In the data engineering world, the difference between a pipeline that works and one that's truly production-ready often comes down to a handful of deliberate decisions. William Orgertrice III , Data Engineer at Cargill , joins us to share the DAG design and monitoring practices he presented at Airflow Summit 2025 and how his team is rolling out Airflow across 60+ internal teams as part of Cargill's new Minerva data platform. Key Takeaways: 00:00 Introduction. 01:45 Cargill is one of the largest privately owned companies in the US, operating across 70 countries and serving 125+ markets. 03:45 William's team on the Cargill Data Platform supports 60+ internal teams, providing data products that drive decisions across finance, inventory and operations. 05:10 Cargill chose Airflow as a core component of its new Minerva data platform to replace older ETL tooling with a more supportable, observable stack. 06:26 Native SLA sensors and dependency management were specific features that made Airflow the right fit for Cargill's batch ingestion pipelines. 09:00 Cargill is running Airflow through Astronomer as their managed solution, with some teams already in production.
What's New in Apache Airflow® 3.377 / 100
Running Airflow 3 in a regulated environment at OTPP57 / 100
Managing a Customer Analytics Platform with Airflow at Skimlinks66 / 100
Building a custom Tableau provider for Airflow at JLR69 / 100
Orchestrating 2,000 Airflow pipelines at Luiza Labs with Mateus Ferreira