How to Rebuild the Social Contract After AGI (with Deric Cheng) - Future of Life Institute Podcast Recap

Podcast: Future of Life Institute Podcast

Published: 2026-01-27

Duration: 1 hr 5 min

Summary

In this episode, Derek Cheng discusses the potential economic disruptions caused by artificial general intelligence (AGI) and emphasizes the need for a new social contract to ensure equitable distribution of wealth and power in a future dominated by AI technologies.

What Happened

Derek Cheng, director of the Windfall Trust, joins the Future of Life Institute podcast to discuss the implications of AGI on the social contract. He highlights the alarming trend of major AI companies focusing on full automation, raising concerns over the concentration of wealth and power within a small number of tech giants. Cheng warns that as AI systems evolve, they could potentially replace millions of jobs, leading to a significant shift in the balance of labor and capital. This scenario, he argues, could result in extreme economic inequality, reminiscent of historical periods marked by unrest and revolution due to concentrated wealth.

Cheng outlines the trajectory of corporate power, noting that a few dominant firms could emerge in various industries, significantly affecting employment and economic outcomes. He emphasizes the importance of preparing for this future by rethinking the social contract to empower human labor and maintain workers' bargaining power. The conversation delves into how the rise of 'superstar firms'—companies supported by AI agents—may exacerbate existing inequalities and calls for a proactive approach to ensure that the benefits of AI are widely shared across society.

Key Insights

• The focus of major AI companies is shifting towards full automation, which could replace many human jobs.
• Concentration of economic power in a few corporations poses risks of extreme inequality and social unrest.
• A new social contract is necessary to empower human labor and maintain workers' bargaining power.
• The trends driven by AI may accelerate existing economic disparities and require attention from all political perspectives.

Key Questions Answered

What is the AGI social contract proposed by Derek Cheng?

Derek Cheng describes the AGI social contract as a framework aimed at reshaping governments and societal structures in light of transformative AI scenarios. His organization, the Windfall Trust, focuses on addressing the economic disruptions expected from AGI, fostering discussions among experts about how to create a social contract that benefits society as a whole. The goal is to ensure that as AI systems evolve, they do not lead to disempowerment of workers but rather support equitable outcomes.

How might AI lead to job loss and economic inequality?

Cheng emphasizes that the trajectory of AI development suggests a significant shift towards full automation, which major tech companies are pursuing. This could lead to the replacement of millions of jobs in various sectors, as companies consolidate power and resources. The risk is that wealth and productivity gains will increasingly concentrate within a small number of corporations, thereby exacerbating inequality and undermining the bargaining power of workers in the marketplace.

What are 'superstar firms' in the context of AI?

In the podcast, Cheng refers to 'superstar firms' as companies that may operate with a small number of employees but are augmented by numerous AI agents, allowing them to scale effectively. These firms could dominate their respective industries, capturing a majority of economic wealth and gains while potentially displacing traditional labor forces. This model raises concerns about the future of work and the potential for significant economic disparity.

Why should both political sides be concerned about AI-driven inequality?

Cheng notes that the trends brought about by AI are likely to accelerate existing economic disparities, which is a concern that transcends political boundaries. Both conservative and liberal factions should recognize the importance of ensuring good outcomes for workers and the economy as a whole. The fear is that significant labor disempowerment could lead to weaker wages and lower consumption, ultimately harming societal welfare, which is a shared concern across the political spectrum.

What strategies can be employed to empower human labor in an AI-driven economy?

Cheng advocates for proactive strategies over the next decade to empower human labor and maintain its relevance as AI technologies advance. This includes advocating for stronger labor rights, better wage structures, and policies that ensure equitable distribution of resources. The aim is to create an environment where human workers can still advocate for their interests and share in the economic benefits generated by AI, thus preserving agency and bargaining power in an increasingly automated world.