Building reliable and proactive agentic systems at scale: how Shopify’s reflexive AI culture was instrumental in their development of Sidekick w/ Andrew McNamara #258

Episode notes

Andrew McNamara, Director of Applied Machine Learning @ Shopify, joins the ELC podcast to share insights on building agentic platforms at scale, like Sidekick, that must keep reliability for its users at the forefront. Andrew describes the building philosophy behind Shopify and what it means to cultivate a culture of prototype-first while prioritizing hiring early-stage talent. We cover Sidekick’s development journey and how user feedback impacted its product vision, why evaluation is so important for determining ground truth sets, and the benefit of user-driven use cases. Andrew also dissects how they went about making product design decisions, such as building proactive agents and identifying subagent specializations. ABOUT ANDREW MCNAMARA Andrew McNamara is Director of Applied Machine Learning at Shopify, where he leads the team behind Shopify Sidekick, an AI co-founder that gives merchants access to the e-commerce expertise they need to run and grow their business.

Related episodes across the Index

Other episodes covering the same guests and topics, from across The B2B Podcast Index.

• Hiring top-tier talent, the importance of adopting an evolutionary mindset, and taking critical feedback to solve technical problems w/ Sergiy Nesterenko @ QuilterEngineering Founders · on Engineering management88 / 100
• What Marketers Can Control When AI Changes Everything with Nick Wedewer, VP of Growth Marketing at Hims & HersThe Partnership Economy · on generative AI87 / 100
• Code Review Is a Taste Problem | David Poll ⁨@GitHub⁩Hangar DX Podcast · on engineering leadership81 / 100
• Building Skills-Powered Organizations in the AI Era with Ravin JesuthasanChange Management Review Podcast · on generative AI81 / 100
• Inside Target’s approach to enterprise AI deployment with Sowmya PodilaThe Ecommerce Toolbox: AI in Retail · on generative AI79 / 100
• Navigating AI Risks with Trevor Horwitz from TrustNetB2B Automation Spotlight · on generative AI79 / 100

• Hiring top-tier talent, leveraging open source models, and staying competitive in the age of AI w/ Benny Chen #26786 / 100
• Determining bets, using customer insights to pivot, and gaining developer buy-in & trust w/ Tomas Reimers #26483 / 100
• Utilizing AI internally to iterate faster and empower smaller teams to upskill w/ Vivek Raghunathan #26396 / 100
• The Product Paradigm Shift: How Livekit Navigated High Stakes Scaling Challenges to Build the Future of Voice-First AI Interfaces w/ Russ d’Sa #26276 / 100
• Building an empowered career w/ Jean Hsu & Cate Huston #26163 / 100