Inside the $41B AI Cloud Challenging Big Tech | CoreWeave SVP - Gradient Dissent: Conversations on AI Recap

Podcast: Gradient Dissent: Conversations on AI

Published: 2026-01-06

Duration: 53 min

Summary

CoreWeave is positioning itself as a leading player in the AI cloud market, focusing on optimizing GPU performance for AI workloads. Corey Sanders, SVP of Product, shares insights on the unique challenges and opportunities in the evolving landscape of AI infrastructure.

What Happened

In this episode of Gradient Dissent, host Lucas Biewald sits down with Corey Sanders, SVP of Product at CoreWeave, to discuss the company's role in the AI cloud sector, which is currently valued at $41 billion. Corey emphasizes the importance of quality and performance in delivering AI workloads, noting that the capabilities they provide today need to evolve rapidly to remain competitive. He explains that CoreWeave is designed to handle the unique requirements of AI workloads, particularly with GPU utilization, which he identifies as the most expensive asset in cloud computing.

Corey reflects on his transition from a two-decade career at Microsoft, where he was deeply involved in cloud technology, to a startup environment at CoreWeave. He shares that while moving from a massive corporation to a smaller company can feel chaotic, it also brings back memories of the early, innovative days at Microsoft. These experiences have shaped CoreWeave's approach to building a robust infrastructure tailored for AI, with a focus on maximizing data throughput into GPUs. This mindset, according to Corey, is what differentiates CoreWeave in a landscape dominated by larger tech companies.

Key Insights

Key Questions Answered

How does CoreWeave differentiate itself in the AI cloud market?

CoreWeave differentiates itself by focusing on the unique requirements of AI workloads, particularly through maximizing data throughput into GPUs. Corey Sanders emphasizes that GPU performance is paramount as it represents the most expensive asset in cloud computing. This focus on optimizing performance allows CoreWeave to address the challenges that public clouds face, making it a preferred choice for companies deploying AI applications.

What insights did Corey Sanders share about his time at Microsoft?

Corey reflects on his 20-year tenure at Microsoft, where he experienced various roles and contributed to significant projects like the early days of infrastructure as a service and container technology. He mentions that those early experiences remind him of the current environment at CoreWeave, where innovation and a bit of chaos often coexist, creating opportunities for growth and creativity.

What are the key challenges in deploying AI workloads on public clouds?

Corey highlights that deploying AI workloads on public clouds often involves managing sudden bursts of capacity and the inherent stress that comes with it. He notes that many companies utilizing public clouds have to 'sweat' their resources, which can lead to performance issues. CoreWeave aims to alleviate this by offering a more specialized infrastructure that can handle these unique demands more effectively.

How has the perception of public data centers changed?

Corey discusses a recent shift in public sentiment regarding the establishment of data centers, particularly in Western countries. He notes that there has been an increasing resistance to these developments without demonstrating tangible benefits to local communities. This realization has prompted companies to focus on how to better communicate the value that their services bring to local businesses.

What is the future outlook for CoreWeave in the AI landscape?

Corey expresses confidence in CoreWeave's future, suggesting that the company is well-positioned to adapt to the evolving demands of AI workloads. He believes that the quality and performance they provide will become even more crucial in the coming years, as competition intensifies and technology continues to advance. CoreWeave's focus on maximizing GPU capabilities will likely keep it at the forefront of the AI cloud sector.