"ZenDB: A Novel Document Analytics System Leverages Semantic Structure for Efficient, Cost-Effective Query Execution, Outperforms LLM and RAG-Based Approaches"

Towards Accurate and Efficient Document Analytics with Large Language Models

View PDF HTML (experimental) Abstract:Unstructured data formats account for over 80% of the data currently stored, and extracting value from such formats remains a considerable challenge. In particular, current approaches for managing unstructured documents do not support ad-hoc analytical queries on document collections. Moreover, Large Language Models (LLMs) directly applied to the documents themselves, or on portions of documents through a process of Retrieval-Augmented Generation (RAG), fail...