Llama3

Effective agent design patterns in production — Laurie Voss, LlamaIndex

Jun 27, 2025 · 15:38

Laurie Voss, VP of Developer Relations at LlamaIndex, presents five agent design patterns—chaining, routing, parallelization, orchestrator workers, and evaluator optimizers—for building production-ready agents. He argues that agents improve RAG by enabling introspection, self-correction, and better accuracy, and that RAG remains essential because it's cheaper and faster than feeding full context. LlamaIndex provides a framework, LlamaParse for parsing complicated documents, and LlamaCloud for managed retrieval endpoints, integrating with 400 models over 80 providers. He demonstrates how workflows in LlamaIndex enable concurrent event emitting to implement parallelization and voting to reduce hallucination, noting that three different LLMs seldom hallucinate the same answer. The evaluator optimizer pattern uses an LLM to check its own output and loop back for improvement. Multi-agent systems can be built with a single line of code by passing an array of function agents.

Accelerate your AI journey with Azure AI model catalog: Sharmila Chokalingam

Feb 6, 2025 · 23:14

Shubhi and Sharmila present the Azure AI model catalog as a platform offering over 1,600 models including GPT-4, Mistral, Llama, Cohere, and Phi3, with a standardized inference API enabling easy model swapping. They demonstrate deployment via serverless API (pay-per-token) and managed compute, emphasizing that customer prompts and completions are not shared with model providers or used for training. The platform includes model benchmarks, playground for RAG, and Prompt Flow for building generative AI apps with evaluation and variant comparison. Customer success stories include EY's EYQ chat adopted by 275,000 employees, CMA CGM's reduced response latency using Mistral, and Bridgestone's 30% reduction in forecasting errors with Nixtla's TimeGen.