The Voice-First AI Overlay: Designing Conversational Co-Pilots - Gregory Bruss
Jun 3, 2025 · 16:44
Gregory Bruss introduces the Voice-First AI Overlay, an agent that assists live human conversations without becoming a third speaker. He argues that as AI grows more powerful, this paradigm can keep humans in the loop through voice, the most natural interface. The overlay passively listens and surfaces relevant help—like language suggestions in a demo—addressing timing, relevance, attention, and latency. Engineering challenges include jitterbug input, context repair, premature interrupts, and glanceable ghost. Bruss emphasizes design principles: transparency, minimal cognitive load, and progressive autonomy. He also explores future directions like full-duplex speech models and on-device inference for privacy.
