Realtime Conversational Video with Pipecat and Tavus — Chad Bailey and Brian Johnson, Daily & Tavus
Jun 27, 2025 · 18:46
Chad Bailey of Daily and Brian Johnson of Tavus explain how to build real-time conversational video bots using the Pipecat open-source framework and Tavus's avatar platform. They argue that beyond models, an orchestration layer is essential for handling input, processing, and output with low latency. Bailey details Pipecat's pipeline of frames, processors, and pipelines that manage audio/video frames, speech-to-text, LLM inference, and text-to-speech in a modular way. Johnson describes Tavus's 600-millisecond response time and proprietary models—Sparrow Zero, Raven Zero—plus future turn detection, response timing, and multimodal perception models being integrated into Pipecat. They emphasize that Pipecat solves real-world production challenges like observability, barge-in handling, and parallel pipelines for tasks like voicemail detection. Johnson admits Tavus initially built its own orchestration but now plans to adopt Pipecat internally, as its customers are already using it.
