Voice Engine

Give Your Chat Agent a Voice — Luke Harries, Head of Growth, ElevenLabs

May 9, 2026 · 8:12

Luke Harries from ElevenLabs argues that the next upgrade for chat agents is a voice layer, not smarter prompts or RAG, and introduces the company's Voice Engine to wrap existing agents via a few lines of code. He demonstrates how text-in, text-out chat agents can be converted to voice agents using a single prompt, leveraging ElevenLabs' advanced turn-taking, emotion-aware interruption detection, and Scribe for speech-to-text. The Voice Engine provides server and client SDKs, plus Shadcn-based UI components, enabling omni-channel deployment like phone calls and Zoom. Harries also addresses tool calling, noting that the wrapper proxies calls to existing agent logic without rebuilding. He predicts that chat agents will either adopt voice or become obsolete.

From Text to Vision to Voice Exploring Multimodality with Open AI: Romain Huet

Jul 10, 2024 · 23:39

OpenAI's Romain Huet demonstrates GPT-4o's real-time audio, vision, and screen-sharing capabilities at the AI Engineer World's Fair, showing how the omni-model achieves human-like conversational latency, understands emotion, and can be interrupted naturally. He walks through live demos of ChatGPT Desktop recognizing drawings, reading book pages, and pair-coding a responsive travel app using Tailwind CSS. Huet also previews Sora's text-to-video generation and OpenAI's unreleased Voice Engine, which can clone a voice from seconds of audio and translate it into multiple languages while preserving the original speaker's tone. He outlines OpenAI's four focus areas: advancing textual intelligence, faster/cheaper models (GPT-4o is twice as fast as GPT-4 Turbo at half the price), model customization via fine-tuning, and enabling multimodal agents. The talk emphasizes that today's models are the dumbest they'll ever be and urges developers to build for a future where AI works across text, voice, and video.