953: Beyond "Agent Washing": AI Systems That Actually Deliver ROI, with Dell's Global CTO John Roese - Super Data Science: ML & AI Podcast with Jon Krohn Recap

Podcast: Super Data Science: ML & AI Podcast with Jon Krohn

Published: 2025-12-30

Duration: 51 min

Guests: John Roese

Summary

John Roese, Dell's Global CTO, discusses the tangible ROI achieved through disciplined AI deployment and warns against the misuse of terms like 'agentic AI.' He offers insights into the components of autonomous agents and the strategic importance of data management in AI systems.

What Happened

John Roese, Dell's Global CTO, shares how the company achieved a remarkable $10 billion increase in revenue while reducing costs by 4%, a first in Dell's 41-year history, through strategic AI deployment. He emphasizes the importance of having a disciplined approach, focusing on high-impact projects with clear ROI, which in some cases reached a 30:1 return ratio.

Roese explains the concept of agentic AI, distinguishing between actual autonomous systems and mere rebrandings or 'agent washing.' He asserts that true agentic AI involves systems that can operate independently without human intervention, a capability expected to become more prominent in 2026.

A critical component of these systems is the knowledge layer, which includes vector databases and knowledge graphs, and should be positioned close to where AI processing occurs to ensure efficiency and responsiveness. This layer allows AI systems to maintain context and memory, essential for their evolving tasks.

Roese outlines the four essential components of autonomous agents: large language models (LLMs) for reasoning and communication, specialized knowledge through knowledge graphs, the ability to interact with the world via MCP, and communication between agents through A2A protocols. These components work together to enable agents to function autonomously and effectively.

The discussion touches on the importance of governance in AI, both internally within companies to avoid inefficiency ('slop') and externally to navigate varied regulatory landscapes. Roese stresses the need for coherent governance frameworks to maximize AI benefits and minimize risks.

AI factories, which Dell has pioneered in collaboration with NVIDIA, are highlighted as pivotal in transforming business resilience and disaster recovery. These factories integrate data, services, and infrastructure to support robust AI deployment, making them a crucial part of modern enterprise strategy.

Finally, Roese mentions the rising significance of sovereign AI, where national strategies are increasingly incorporating AI to enhance various sectors, reflecting a global trend towards localized AI governance and infrastructure.

Key Insights

• Dell achieved a $10 billion revenue increase while reducing costs by 4% through strategic AI deployment, focusing on projects with clear ROI, sometimes reaching a 30:1 return ratio.
• Agentic AI systems, expected to become more prominent by 2026, are autonomous and operate independently without human intervention, distinguishing them from rebranded systems or 'agent washing.'
• The knowledge layer, incorporating vector databases and knowledge graphs, is crucial for AI systems to maintain context and memory, and should be positioned close to AI processing for efficiency.
• Dell's collaboration with NVIDIA on AI factories integrates data, services, and infrastructure to enhance business resilience and disaster recovery, forming a key element of modern enterprise strategy.