NVIDIA's AI Engineers: Agent Inference at Planetary Scale and "Speed of Light" — Nader Khalil (Brev), Kyle Kranen (Dynamo) - Latent Space: The AI Engineer Podcast Recap

Podcast: Latent Space: The AI Engineer Podcast

Published: 2026-03-10

Duration: 1 hr 24 min

Summary

In this episode, Nader Khalil and Kyle Kranen from NVIDIA discuss the evolving capabilities of AI agents, particularly focusing on their functionalities, security considerations, and the innovative marketing strategies that can set tech startups apart in a competitive landscape.

What Happened

The episode kicks off with a deep dive into the capabilities of AI agents, highlighting three primary functions: accessing files, accessing the internet, and writing custom code. Nader emphasizes that for security reasons, it's advisable to allow agents access to only two of these three functions to prevent potential vulnerabilities. He reflects on the need to both harness the promise of AI while implementing effective safeguards to protect against threats like malware.

As the conversation progresses, the hosts discuss their experiences leading up to NVIDIA's GTC event, with an amusing anecdote from Nader about his marketing efforts while at Brev. He recounts a memorable moment where he and his team decided to embrace their startup identity by branding their booth with surfboards and palm trees, making a lasting impression at the conference. This strategy contrasted sharply with the more generic approaches often seen at tech events, showcasing the importance of creativity in marketing for tech startups.

They also touch upon the origins of Brev, a developer tool designed to simplify GPU access. Nader explains how his team focused on user experience, ensuring that the process of obtaining a GPU was straightforward and visually engaging. The discussion highlights the innovative design choices made in creating Brev, from using SVG animations to enhance the user interface to the playful marketing tactics that helped the company stand out in a crowded field.

Key Insights

Key Questions Answered

What are the main functions of AI agents?

Nader Khalil outlines that AI agents can access files, access the internet, and write custom code. However, he advises that it's prudent to only allow agents to perform two of these functions at a time to minimize security vulnerabilities. This insight reflects the growing awareness of cybersecurity as AI capabilities expand.

How did Brev differentiate itself at tech conferences?

Nader shares a fun anecdote about how Brev's marketing strategy involved using surfboards and palm trees at their booth during GTC. This approach was a deliberate choice to stand out amidst generic representations from other companies, emphasizing the importance of creativity in tech marketing.

What is Brev and how does it function?

Brev is introduced as a developer tool that streamlines the process of accessing GPUs. Nader elaborates that the tool is designed to simplify the user experience, allowing developers to quickly SSH into a GPU without the cumbersome forms typically associated with cloud services.

What innovative design choices were made in Brev?

Nader discusses the creation of beautiful animations for GPU selections, originally crafted in Figma and then translated into functional SVG code. This attention to detail in user interface design was part of a broader effort to make the tool visually appealing and user-friendly.

What lessons can startups learn from Brev's marketing tactics?

The episode emphasizes the significance of authenticity and creativity in branding. By embracing their identity as a small startup and engaging in memorable marketing stunts, Brev was able to leave a lasting impression on potential customers and industry peers, illustrating a key strategy for success in a crowded market.