Creating a private AI assistant in Thunderbird - Practical AI Recap

Podcast: Practical AI

Published: 2025-09-23

Duration: 53 min

Guests: Chris Aquino

Summary

Thunderbird is experimenting with integrating a private AI assistant to enhance email management while prioritizing user privacy. The approach involves using confidential remote inference through Flower Labs to ensure data protection.

What Happened

Chris Aquino, a software engineer at Thunderbird, explains the journey of creating a private AI assistant for Thunderbird users, focusing on privacy and data security. The assistant, named Thunderbird Assist, is designed to perform tasks like summarization and reply generation without compromising user privacy. Aquino shares the challenges faced, such as ensuring the AI model could operate effectively without storing or using personal data for training.

Flower Labs was chosen as the technical partner to facilitate this private AI implementation. They provided end-to-end encryption and a private Large Language Model (LLM) infrastructure, allowing Thunderbird to maintain data privacy. Aquino highlights how Flower Labs adapted their roadmap to meet Thunderbird's needs, enhancing the AI's effectiveness in handling email tasks.

A significant part of the development was determining the best approach to integrate AI features without burdening users' devices or compromising privacy. Aquino discusses the decision to avoid embedding AI directly within the Thunderbird desktop application, instead opting for an external approach that maintains user control over their data.

The episode delves into the technical considerations and solutions, such as using a Bayesian classifier for local processing to reduce reliance on external AI systems. This method improved efficiency and ensured users' devices weren't overwhelmed with processing tasks.

Aquino expresses the importance of user feedback in shaping the AI features. Different users have varying needs, from summarizing long email threads to managing information overload. The development team is considering ways to expand AI capabilities to handle multiple data sources, like calendars and RSS feeds, for a more comprehensive personal information management tool.

Looking ahead, Aquino envisions a future where Thunderbird can leverage AI to assist users in managing personal knowledge across various applications. This includes potentially using federated learning to enable offline semantic search, enhancing productivity without sacrificing privacy.

Key Insights