RAG for VPs of AI: Jerry Liu
Dec 31, 2024 · 26:51
Jerry Liu, CEO of LlamaIndex, argues that building production RAG systems requires a new data processing stack distinct from traditional ETL, emphasizing data quality through advanced parsing (Llama Parse) and rigorous eval over chunk size tuning. He explains that while longer context windows may eliminate fine-grained chunking, retrieval from external storage remains vital for multi-doc enterprise systems. Liu addresses data privacy with VPC deployment options, and notes that Llama Cloud processes but does not store data. He also highlights Llama Agents, an open-source multi-agent framework for deploying agentic microservices, and shares that Llama Parse processes tens of millions of pages monthly.
