Ofer Mendelevitch

Enterprise Deep Research: The Next Killer App for Enterprise AI — Ofer Mendelevitch, Vectara

Nov 24, 2025 · 5:19

Ofer Mendelevitch from Vectara introduces Enterprise Deep Research as the next killer app for enterprise AI, applying autonomous, multi-step reasoning to internal knowledge bases. Vectara's trustworthy agent OS enables this with multimodal ingest, hybrid retrieval, and hallucination mitigation (HHEM model at 5.5M downloads). Deep Research queries private data to generate comprehensive reports with citations, replacing manual workflows. Key use cases include responding to RFPs by scanning enterprise datasets, generating on-demand employee onboarding guides from Jira/Notion/SharePoint, and creating investment memos in financial services. The system uses multi-agent parallel execution and corpus understanding for accurate planning, addressing 73% of LLM users' top challenge: factual accuracy.

open-rag-eval: RAG Evaluation without "golden" answers — Ofer Mendelevitch, Vectara

Jun 3, 2025 · 5:03

Ofer Mendelevitch from Vectara presents Open-RAG-Eval, an open-source framework that enables RAG evaluation without requiring golden answers or golden chunks, solving a major scalability problem. Backed by research with the University of Waterloo's Jimmy Lin Lab, it uses UMBRELA for retrieval scoring on a 0–3 scale that correlates well with human judgment, and AutoNuggetizer for generation via nugget creation, Vital/OK ratings, and an LLM judge analyzing the top 20 nuggets for support. Additional metrics include citation faithfulness and Vectara's HHEM hallucination detection model. Connectors are available for Vectara, LangChain, and LlamaIndex, with results viewable through an intuitive UI at OpenEvaluation.ai.