Jerry Liu

Building AI Agents that actually automate Knowledge Work - Jerry Liu, LlamaIndex

Jun 24, 2025 · 17:57

Jerry Liu, CEO of LlamaIndex, argues that building AI agents which actually automate knowledge work requires a combination of really good tools and carefully tailored agent reasoning, moving beyond naive RAG to a 'document toolbox' that includes parsing, extraction, indexing, and manipulation of complex unstructured data like PDFs, Excel, and PowerPoints. He introduces two main agent categories: assistive agents (chat-based, human-in-the-loop, unconstrained reasoning) and automation agents (batch-processing, constrained workflows, less human oversight). A key new capability is an Excel agent that uses reinforcement learning to learn a semantic map of unnormalized spreadsheets, achieving 95% accuracy on data transformation, surpassing the 75% baseline of LLMs with code interpreter and even human baselines of 90%. Real-world examples include financial due diligence combining automation (inhaling financial data) and assistant interfaces (analyst co-pilot), enterprise search with specialized agentic RAG, and technical data sheet injection for a global electronics company that reduced weeks of manual work to an automated extraction pipeline. Liu emphasizes that the right preprocessing…

RAG for VPs of AI: Jerry Liu

Dec 31, 2024 · 26:51

Jerry Liu, CEO of LlamaIndex, argues that building production RAG systems requires a new data processing stack distinct from traditional ETL, emphasizing data quality through advanced parsing (Llama Parse) and rigorous eval over chunk size tuning. He explains that while longer context windows may eliminate fine-grained chunking, retrieval from external storage remains vital for multi-doc enterprise systems. Liu addresses data privacy with VPC deployment options, and notes that Llama Cloud processes but does not store data. He also highlights Llama Agents, an open-source multi-agent framework for deploying agentic microservices, and shares that Llama Parse processes tens of millions of pages monthly.

The Future of Knowledge Assistants: Jerry Liu

Jul 13, 2024 · 16:55

Jerry Liu, CEO of LlamaIndex, explains how to move beyond simple RAG to build production-grade knowledge assistants. He details three steps: advanced data processing with LlamaParse for accurate PDF parsing, single-agent flows with query planning and tool use, and multi-agent task solvers via the newly announced Llama Agents framework. Llama Agents treats each agent as a deployable microservice that communicates through a central API, enabling specialization, parallelism, and easier production deployment. Jerry also highlights that naive RAG is insufficient for complex queries, and that good data quality—like proper parsing of tables and charts—is essential to reduce hallucinations.

Building Production-Ready RAG Applications: Jerry Liu

Nov 15, 2023 · 18:35

Jerry Liu, CEO of LlamaIndex, explains how to productionize Retrieval Augmented Generation (RAG) systems by moving beyond naive implementations. He identifies key challenges: low retrieval precision causing hallucination, low recall from insufficient top-K, and lost-in-the-middle problems. Liu advocates starting with 'table stakes' improvements like tuning chunk sizes (showing optimal values per dataset), adding metadata filters (e.g., year=2021 for SEC 10Q queries), and hybrid search. More advanced techniques include 'small-to-big retrieval', embedding smaller chunks for precision then expanding windows for synthesis, and using reranking to improve recall. Finally, he explores agent architectures where each document becomes a tool for summarization or QA, and fine-tuning—generating synthetic query datasets from raw text to fine-tune embeddings, or distilling GPT-4's chain-of-thought into GPT-3.5 Turbo for better reasoning.