Matt Carey

Why Eval++ Is the Next Great Compute Primitive — Sunil Pai & Matt Carey, Cloudflare

Jun 8, 2026 · 24:51

Matt Carey and Sunil Pai from Cloudflare's agents team argue that Durable Objects — stateful serverless with 15ms London latency — and Dynamic Workers — a safe, sandboxed eval for LLM-generated code — form the next compute primitive for AI agents. They explain how Durable Objects enable resumable streaming, multi-tab sync, and background scheduling out of the box without distributed systems engineering. Dynamic Workers allow running generated JavaScript strings in isolated sandboxes, reclaiming 30 years of avoided eval. The pair tease upcoming talks: one on collapsing Cloudflare's 2,600 API endpoints into a 1,000-token MCP tool, and another on a coding agent harness built entirely on Workers that they are already shipping.

MCP = Mega Context Problem - Matt Carey

Apr 25, 2026 · 22:42

Matt Carey from Cloudflare argues that the real bottleneck in connecting agents to APIs via MCP is the context window, not the protocol itself. Cloudflare’s OpenAPI spec is 2.3 million tokens; naive tool generation would consume 1.1 million, overwhelming any agent. To solve this, Carey advocates progressive discovery: CLIs (requiring shell access), tool search (loading only relevant tools), or codemode—letting agents write code against a typed SDK and execute it in Cloudflare’s isolated Workers sandbox. This sandbox provides safe, programmable guardrails (no secrets, limited network access), allowing agents to access all 2,600+ Cloudflare API endpoints from a single MCP server. Carey predicts that as agents become code generators, infrastructure primitives like WorkerD, Deno, and Pydantic will proliferate, and MCP servers will become a lightweight middleware flag (e.g., `MCP: true` in Next.js). The talk demonstrates read-only access to the entire Cloudflare API from an MCP client, showing codemode in action.