The Data Flowcast · 2026-05-28 · 33 min
Running Airflow at the scale of a national retailer means more than just scheduling. It means giving non-engineers a path to ship DAGs, and classifying thousands of runs to know which ones need attention. In this episode, Mateus Ferreira, Senior Data Engineer at Luiza Labs (the technology arm of Magazine Luiza, one of Brazil's largest retailers), joins Marc to talk about the patterns his team uses to run 2,000+ Airflow pipelines across more than four petabytes of data. Key Takeaways: 00:00 Introduction 01:11 Mateus introduces himself and Luiza Labs, the technology arm of Magazine Luiza (Magalu), one of Brazil's largest retailers (founded 1957). 1,000+ physical stores, multi-region operations, and a data team that has to handle the variability that comes with all of it. 04:33 Lu Brain, Magalu's AI initiative built around their character Lu, and how AI fits into the data work. 06:47 The data reliability engineering channel where AI summarizes Airflow errors with confidence scores and posts a suggested fix in chat. 08:30 How Airflow became the heart of orchestration.
What's New in Apache Airflow® 3.377 / 100
Running Airflow 3 in a regulated environment at OTPP57 / 100
Managing a Customer Analytics Platform with Airflow at Skimlinks66 / 100
Building a custom Tableau provider for Airflow at JLR69 / 100
Enhancing DAGs for Data Processing with William Orgertrice III at Cargill