Scribe

Give Your Chat Agent a Voice — Luke Harries, Head of Growth, ElevenLabs

May 9, 2026 · 8:12

Luke Harries from ElevenLabs argues that the next upgrade for chat agents is a voice layer, not smarter prompts or RAG, and introduces the company's Voice Engine to wrap existing agents via a few lines of code. He demonstrates how text-in, text-out chat agents can be converted to voice agents using a single prompt, leveraging ElevenLabs' advanced turn-taking, emotion-aware interruption detection, and Scribe for speech-to-text. The Voice Engine provides server and client SDKs, plus Shadcn-based UI components, enabling omni-channel deployment like phone calls and Zoom. Harries also addresses tool calling, noting that the wrapper proxies calls to existing agent logic without rebuilding. He predicts that chat agents will either adopt voice or become obsolete.

Training an LLM from Scratch, Locally — Angelos Perivolaropoulos, ElevenLabs

May 4, 2026 · 1:21:26

Angelos Perivolaropoulos from ElevenLabs walks through building a small GPT-2-like LLM from scratch on a local machine, demonstrating that the core techniques used by major labs are accessible in a few hundred lines of PyTorch code. The workshop uses character-level tokenization (65 tokens) on a Shakespeare dataset to enable fast training with limited compute. The model architecture includes multi-head self-attention, MLP layers, residual connections, and layer normalization, totaling 10 million parameters across six transformer blocks with a 256-token context window. The training loop employs next-token prediction with a warm-up cosine decay learning rate schedule and validation loss to detect overfitting. Inference uses temperature sampling (default 0.7) and top-k sampling to improve creativity. Perivolaropoulos explains that audio and multimodal models share the same transformer foundation but differ in tokenization (e.g., mel-spectrograms for audio) and use specialized losses like L2 or KL divergence, while reasoning models result from post-training base models with high-quality chain-of-thought data.