Lyria

From Transcription to Live Music: Gemini's Audio Stack — Thor Schaeff, Google DeepMind

Jun 9, 2026 · 19:34

Thor Schaeff from Google DeepMind presents the Gemini audio stack—Gemini 3 Flash Preview for deep audio understanding, Gemini 3.1 Flash Live for real-time sound-to-sound multimodal interaction, and Lyria 3 for music generation. He shows how a single API call extracts speaker labels, timestamps, emotions, language detection, and translation, and how speech generation uses a 'director's note' to modify a base voice's accent and tone. The talk culminates in a live demo where the Gemini Live model uses Lyria via tool calls to generate a German techno schlager about the UK startup scene.

Let's go Bananas with GenMedia — Guillaume Vernade, Google DeepMind

May 18, 2026 · 1:17:14

Guillaume Vernade from Google DeepMind demonstrates the full GenMedia stack—Nano Banana for images, Veo for video, Lyria for music, and TTS—by illustrating an open-source book live. The core insight is that Gemini acts as the prompt engineer for every other model, and this works partly because the gen media models were trained on prompts written by Gemini. He shows how to generate character portraits, chapter scenes, animated video clips using images as first frames, and distinct music per chapter, with Lyria Realtime allowing continuous music that responds to new prompts like a DJ. A new interactions API caches context server-side to make chained multi-turn calls cheaper. For TTS, he uses a trick: assigning different speaking styles (e.g., long poetic pauses vs. breathless stutter) to the same two voices to create four distinct-sounding characters.

Building Conversational Agents — Thor Schaeff and Philipp Schmid, Google DeepMind

Apr 30, 2026 · 1:47:34

Thor Schaeff and Philipp Schmid of Google DeepMind demonstrate building conversational agents with the Gemini Interactions API and Live API, arguing that the new Interactions API simplifies agent development by introducing server-side state management, unified content blocks, and remote MCP support. They walk through creating a coding agent with read/write file and bash tools using Gemini 3 Flash, highlighting how the model uses tool calling to execute commands and return results. The Live API, powering real-time voice and video interactions, supports native multilingual audio, tool calling, and Google Search grounding, though the presenters acknowledge its current limitations in production, including lack of session transcript retrieval and shorter context windows (15 minutes audio-only). They showcase a Live Jukebox demo integrating Lyria 3 music generation and discuss business use cases like Shopify Sidekick, Waymo, and elderly companion apps, emphasizing that while the technology is ready for experimentation, production readiness depends on partner integrations for observability and compliance.

Build & deploy AI-powered apps — Paige Bailey, Google DeepMind

Apr 29, 2026 · 1:03:20

Paige Bailey, engineering lead for developer relations at Google DeepMind, demonstrates how the company's latest multimodal models and AI Studio platform enable rapid prototyping of AI-powered apps at minimal cost. She showcases Gemini 3.1 Flash Lite analyzing YouTube dinosaur videos for under a penny, the new Build feature constructing a fully functional bookshelf cataloger with Firebase database and Google login, and Gemini Live providing real-time multilingual screen interaction. Other demos include Genie 3 generating playable world models from text prompts, NanoBanana 2 performing cost-effective image editing, Veo 3.1 Lite producing stock footage (e.g., a "vegan basketball food truck" featuring Chef Curry), Lyria 3 creating custom music tracks, and Gemma 4 offering open-source multimodal models that run on mobile devices. Bailey emphasizes that the entire stack—grounded by Google Search and code execution—allows developers to ship ideas that would have been startups years ago, with all code exportable for production use.

Veo 3 for Developers — Paige Bailey, Google DeepMind

Jun 21, 2025 · 20:37

Paige Bailey, engineering lead for Google DeepMind's DevRel team, presents Veo 3, the latest video generation model that natively produces synchronized audio—dialogue, sound effects, and music—from text and image prompts, marking a leap in coherence, physics simulation, and cinematic control. She demonstrates Veo 2's creative controls like reference-powered videos, outpainting, and character consistency, and shows how video generation has evolved from 2023's choppy clips to Veo 3's polished raccoon dancing in front of pyramids. A key demo replicates a Chick-fil-A commercial: Veo 2 required stitching multiple tools, while Veo 3 produced the full ad from a single prompt. The models are accessible via Vertex AI private preview and Gemini Ultra plans.