Prodity: Product by Design · 2025-02-07 · 46 min
In this episode of Product by Design , Kyle chats with Sandy Ryza, lead engineer on the Dagster project, author, and thought leader in data engineering. Sandy shares his journey through the world of data - from building big data tools at Cloudera to working as a data scientist, product manager, and engineer - and how those experiences led him to help create Dagster, an open-source data orchestration platform. We discuss: The evolution of data engineering and the growing complexity of modern data pipelines. The role of AI and unstructured data in shaping the future of data platforms. How organizations should think about data platforms to avoid costly rework. Best practices for managing data complexity using software engineering principles. The future of open-source tools in data infrastructure and the push toward interoperability. Sandy Ryza Sandy is a lead engineer, author, and thought leader in the domain of data engineering. Sandy co-wrote “Advanced Analytics with PySpark” and “Advanced Analytics with Spark”. He led ML and data science teams at Cloudera, Remix, Clover Health, and KeepTruckin.
Harnessing AI in Healthcare: Insights from RJ Kedziora65 / 100Unlocking the Secrets of AI Entrepreneurship with Founder Andrew AmannEngineering, Entrepreneurship, and Evolving Teams - with Jason MonbergStructured Thinking for Unstructured Data: A Conversation with Founder Kirk MarpleRevolutionizing Investment Research with AI