Shopify VP of Product on Transforming SaaS to AI-Native and Building $100B+ Agent-Led Commerce | Vanessa Lee | E288 - The Product Podcast Recap
Podcast: The Product Podcast
Published: 2026-03-18
Guests: Vanessa Lee
What Happened
Vanessa Lee, the Vice President of Product at Shopify, discusses Shopify's transition from a traditional SaaS company to an AI-native entity. This shift includes partnering with OpenAI to enhance the discoverability of eCommerce stores through AI agents. Shopify has a significant market presence, with a market cap exceeding $165 billion and over $1.1 trillion in sales powered by its platform.
Lee, a two-time Y Combinator founder, highlights the importance of maintaining a builder's mindset and staying deeply involved in technical details to ensure product cohesion. Her background in robotics engineering and previous experience, such as working on Buffer Box acquired by Google, inform her approach to product leadership at Shopify.
Under Lee's leadership, Shopify has developed AI-native products and agents, focusing on adapting product management to handle AI's indeterministic nature. Shopify evaluates AI product quality using internal tools that assess changes in architecture and integration effects. Sidekick, an assistant product, undergoes evaluation with an LLM-based structure, where ACEs score conversations on various dimensions.
The evaluation process for AI products like Sidekick includes multiple criteria such as accuracy, groundedness, and merchant satisfaction. This rigorous process ensures alignment on subjective evaluations and improves non-deterministic features by generating a ground truth set for training. Another product, Flow, automates tasks and employs a similar judge system to evaluate outputs.
Lee describes the culture at Shopify as one that values autonomy and intense involvement in product details, which can be both challenging and rewarding. She employs 'sprints' to engage deeply with teams when necessary, ensuring that problems are understood and addressed effectively. Regular project reviews by the leadership team allow for informed decision-making and strategic deep dives.
Lee recounts a story of convincing Shopify's CEO to implement API versioning, underscoring the importance of deep knowledge and preparation. She used a simple hand-drawn diagram to facilitate collaborative input, illustrating how effective communication can lead to significant organizational changes. Lee believes that product managers should embody 'courage as a service', making difficult decisions and encouraging pushback to foster innovation.
Key Insights
- Shopify is transitioning to an AI-native company, partnering with OpenAI to enhance AI agent discoverability for eCommerce stores. This strategic shift aims to leverage AI's potential to transform how products are managed and marketed.
- Vanessa Lee emphasizes the importance of a builder's mindset and staying involved in technical details to ensure cohesive product development. Her background in robotics engineering and previous entrepreneurial experience inform her approach to product leadership at Shopify.
- Shopify employs a rigorous evaluation process for its AI products, such as Sidekick and Flow, using criteria like accuracy and merchant satisfaction. These evaluations involve multiple product managers to ensure alignment and improve the quality of non-deterministic features.
- Lee believes that effective communication and preparation are key to driving change within an organization. She demonstrated this by successfully advocating for API versioning at Shopify using a simple diagram to present her proposal.