Arvind Jain on Building Glean and the Future of Enterprise AI - Gradient Dissent: Conversations on AI Recap

Podcast: Gradient Dissent: Conversations on AI

Published: 2025-08-05

Duration: 44 min

Summary

Arvind Jain discusses the inception and evolution of Glean, an enterprise AI company that leverages large language models to streamline internal information searches. He emphasizes the transformative role of transformers in enhancing search capabilities within organizations.

What Happened

In this episode, host Lucas B. Wald engages with Arvind Jain, the CEO of Glean, to explore the company’s innovative approach to enterprise AI. Glean, which Jain describes as 'chat GPT, but inside your company', focuses on connecting employees with their internal systems and data to enhance productivity. The company aims to facilitate a seamless search experience where users can easily find information or connect with the right people without navigating through multiple systems.

Jain reflects on the company's journey, revealing that Glean was founded in early 2019, before the widespread recognition of large language models (LLMs). The initial focus was on addressing the challenge of information retrieval within enterprises, where employees often spend a significant portion of their time searching for documents and data. Jain highlights the impact of transformer technology, which was already making waves in search engines, and how Glean utilized it to create a more intelligent search experience. This foundation allowed Glean to evolve from a traditional search tool to a more advanced AI assistant capable of understanding and answering users' inquiries effectively.

As AI capabilities advanced, Glean adapted its offerings, transitioning from a 'Google for work' to a 'chat GPT for work'. Jain emphasizes that the company harnessed the power of transformers to not only match questions with information but also to understand the content deeply, enabling precise answers. He underscores the importance of leveraging existing innovations rather than reinventing the wheel, which guides Glean's development strategy as they continue to integrate cutting-edge AI capabilities into their platform.

Key Insights

• Glean operates as an enterprise AI solution, enhancing internal information retrieval for organizations.
• Transformers played a crucial role in Glean's development, enabling advanced semantic matching of information.
• The shift from traditional search to AI-driven assistance reflects the evolving capabilities of language models.
• Glean’s strategy focuses on leveraging external innovations to enhance their offerings without unnecessary reinvention.

Key Questions Answered

What is Glean and how does it function?

Glean is an enterprise AI company that connects employees with their internal systems and data, delivering a chat GPT-like experience. It allows users to ask questions and receive answers based on the organization's knowledge and data, streamlining the process of information retrieval within companies.

How did Glean's vision evolve with the rise of LLMs?

Initially founded in 2019 when LLMs were not widely recognized, Glean focused on solving the problem of information retrieval. As LLM capabilities advanced, Glean evolved from a traditional search tool to an AI assistant capable of understanding and providing precise answers, reflecting the transformative potential of AI in enterprise settings.

What challenges in information retrieval does Glean address?

Glean addresses the significant challenge employees face in finding information within their organizations, where data is often spread across various systems. Jain notes that prior to Glean, employees spent a considerable amount of their working time trying to locate documents and information, which led to frustration and inefficiency.

What role do transformers play in Glean's technology?

Transformers were foundational to Glean's development, enabling a more sophisticated understanding of information and improving the search experience. Jain explains that the technology allowed Glean to move beyond traditional keyword-based search systems to a more conceptual matching of information, significantly enhancing the accuracy of search results.

How does Glean leverage external innovations in its development?

Glean's strategy emphasizes not reinventing existing technologies but rather leveraging external innovations. Jain advises his technology team to maximize the use of advancements made outside the company, ensuring that Glean remains competitive and utilizes the best available technologies to serve its customers effectively.