The Modern CTO of 2025 is Rob Duffy, CTO at HealthEdge! - Modern CTO Recap

Podcast: Modern CTO

Published: 2026-01-08

Duration: 20 min

Summary

In this episode, Rob Duffy discusses the challenges and strategies involved in migrating work from human cognition to AI systems, emphasizing the need for structured frameworks akin to cloud migrations. He highlights the cultural shifts required within organizations as they adapt to AI technologies.

What Happened

Joel Beasley introduces Rob Duffy, the CTO of HealthEdge, who shares insights from a recent healthcare technology conference focused heavily on AI. Rob notes that while the development of AI is advancing rapidly, the adoption and practical use cases lag behind, resulting in what he describes as 'demo fatigue.' Organizations are recognizing the potential of AI but struggle to translate flashy presentations into real-world applications that deliver tangible ROI.

Duffy delves deeper into the parallels between cloud migrations and the transition to AI systems, emphasizing that the latter lacks the structured approach seen in cloud transitions. He suggests that organizations need to create a similar infrastructure to manage the shift to AI, including project management offices and frameworks to assess and implement these changes. This structured migration is critical as it involves not just technological changes but also significant cultural shifts within teams, which he believes will be one of the largest transformations in the coming century.

Amid these changes, Duffy highlights a prevalent concern among employees regarding job security as work shifts to AI systems. He reflects on historical precedents where automation reduced team sizes but argues that the evolution will create new roles focused on overseeing and optimizing AI outputs. Duffy encourages organizations to embrace these shifts, suggesting that the future will belong to teams that quickly adapt to integrating AI into their processes, and shares his experience with fostering an environment of grassroots LLM adoption within HealthEdge, complete with gamification and collaborative sharing of tools.

Key Insights

Key Questions Answered

What is demo fatigue in AI presentations?

Demo fatigue refers to the overwhelming number of flashy AI demonstrations and presentations that attendees are exposed to, particularly at conferences. Rob Duffy indicates that while AI technology is advancing rapidly, the practical applications and real-world use cases are not keeping pace with the development. This disconnect leads to skepticism and a lack of actionable insights for organizations exploring AI solutions.

How does AI migration compare to cloud migration?

Duffy draws a parallel between AI migration and cloud migration, noting that the latter has established frameworks and processes for implementation. He stresses that AI migration lacks a similar structured approach, which is essential for organizations to effectively transition work from human cognition to AI systems. Without these frameworks, companies struggle to realize the potential ROI from AI investments.

What cultural changes are needed for AI adoption?

Cultural changes are critical as organizations shift towards AI and agentic systems. Duffy emphasizes that engineering leadership faces the significant challenge of altering team dynamics and work structures. This transition not only involves integrating new technologies but also addressing employee fears about job security and redefining roles within teams to accommodate the new technology landscape.

What new roles will emerge with AI integration?

As work becomes increasingly automated, Rob Duffy suggests that new roles will develop around supervising AI systems. He believes that software engineers will shift from traditional tasks to focusing on managing and optimizing AI outputs, thus creating a demand for skills in areas such as prompt engineering and system architecture that align with AI capabilities.

How is HealthEdge implementing AI tools?

HealthEdge is adopting AI through a grassroots approach, starting with a pilot program involving 53 users utilizing Claude by Anthropic. Duffy shares how the company encourages participation through gamification and collaborative sharing of projects, fostering a community atmosphere that sparks creativity and collective intelligence around AI tool usage.