A product discussed on AI Engineer.

Give Your Chat Agent a Voice — Luke Harries, Head of Growth, ElevenLabs
May 9, 2026 · 8:12
Luke Harries from ElevenLabs argues that the next upgrade for chat agents is a voice layer, not smarter prompts or RAG, and introduces the company's Voice Engine to wrap existing agents via a few lines of code. He demonstrates how text-in, text-out chat agents can be converted to voice agents using a single prompt, leveraging ElevenLabs' advanced turn-taking, emotion-aware interruption detection, and Scribe for speech-to-text. The Voice Engine provides server and client SDKs, plus Shadcn-based UI components, enabling omni-channel deployment like phone calls and Zoom. Harries also addresses tool calling, noting that the wrapper proxies calls to existing agent logic without rebuilding. He predicts that chat agents will either adopt voice or become obsolete.

Building in the Gemini Era – Kat Kampf & Ammaar Reshi, Google DeepMind
Dec 15, 2025 · 17:57
Kat Kampf and Ammaar Reshi from Google DeepMind present Gemini 3 and Nano Banana Pro, arguing that these models enable anyone to build complex, aesthetic applications through natural language alone. Gemini 3 achieves state-of-the-art results in one-shot UI design and agentic tool calling, with SweBench outperformance. Nano Banana Pro integrates Google Search for world knowledge and renders text accurately, handling up to 14 consistent people per image. They demonstrate vibe coding in AI Studio, building a personalized comic book with precise text, laptop stickers grounded in search, and a 3D racing game that scaled to 23 players live. Upcoming full-stack runtime adds backend support and automatic database integration, further democratizing software creation.

Using OSS models to build AI apps with millions of users — Hassan El Mghari
Jul 15, 2025 · 18:47
Hassan El Mghari, a software engineer at Together.ai, explains how he builds open source AI apps that attract millions of users, including roomGPT.io (2.9 million users), restorePhotos.io (1.1 million), Blinkshot.io (1 million visitors), and LlamaCoder.io (1.4 million visitors). He details his simple four-step tech stack: user input, a single API call to an open source model on Together.ai, storing results in a database, and displaying output. His process emphasizes keeping ideas simple enough to describe in five words, spending 80% of time on UI, launching early, and incorporating the latest models like Fluxionel for virality. He advises naming apps with short, memorable names, making them free and open source to encourage sharing, and iterating rapidly—most apps fail, but the key is to keep building. He funds compute through sponsorships from Together.ai and partners like Neon and Clerk, which provide free services for his open source projects.

12-Factor Agents: Patterns of reliable LLM applications — Dex Horthy, HumanLayer
Jul 3, 2025 · 17:06
Dex Horthy, founder of HumanLayer, presents the 12-Factor Agents framework for building reliable LLM-powered applications, arguing that production-grade agents are primarily deterministic software with targeted LLM steps rather than fully autonomous loops. He distills patterns: own prompts and context windows, treat tools as JSON and code, use small focused agents with three to ten steps, contact humans via tool calls. Horthy emphasizes context engineering—LLMs are pure functions—and shows how to compact errors, unify state, and add pause/resume via APIs. He shares a DevOps agent that became a bash script, and advocates for outer-loop agents. The framework, which gained 4,000 GitHub stars in two months, treats agents as stateless reducers that meet users on any channel, with engineers controlling the inner loop of token and control flow.

How Codeium Breaks Through the Ceiling for Retrieval: Kevin Hou
Jul 31, 2024 · 18:42
Kevin Hou, AI engineer at Codeium, argues that embedding-based retrieval is hitting a ceiling for AI code generation and that Codeium breaks through by throwing large language models directly at the problem via a system called MQuery. He outlines the limitations of long context, fine-tuning, and embeddings, noting that embeddings are cheap but fail to reason over multiple documents needed for real-world coding tasks. Codeium developed a product-driven benchmark using recall 50 and commit-message datasets to measure retrieval quality. Because Codeium is vertically integrated—training custom models and building its own infrastructure—it can afford to run thousands of LLM calls in parallel per query, giving users 100x more compute than competitors. MQuery retrieves context from thousands of files in seconds, resulting in more accepted completions and better chat satisfaction. Hou compares this shift to autonomous driving: early heuristics like embeddings are giving way to large models that handle more data directly.
Powered by PodHood