arXiv cs.AI· Fakabbir Amin·· 14 小时前AI 评分38
超越相似度搜索：面向企业 RAG 的知识图谱元数据增强
Beyond Similarity Search: Knowledge Graph Metadata Enrichment for Enterprise Retrieval-Augmented Generation
AI 导读
研究用知识图谱存储元数据与频繁变动信息，能否在企业文档检索中胜过基于嵌入向量的相似度搜索。实验基于 SEC EDGAR 单季度快照，含 10,511 家公司 167,050 份文件、508,714 个嵌入文本块，并构建 430,257 节点、561,144 条边的知识图谱。
正文 · 原文
Abstract:A key challenge of RAG systems is retrieving information from enterprise documents created by multiple teams over time, where it is not possible to enrich the information using the latest information and metadata available outside the scope of organizational documentation responsibility. We investigated whether using a knowledge graph to store metadata and frequently changing information would improve upon knowledge retrieval over similarity search over embeddings. To perform the experiment, we created a snapshot of the SEC EDGAR dataset for a quarter, comprising 167,050 filings from 10,511 companies and 508,714 embedded chunks of risk-factor text. To simulate the enrichment, we created a knowledge graph of 430,257 nodes and 561,144 edges carrying an accession number on every edge. To evaluate the gain obtained via a graph-based design, we evaluated three architectures: text-to-SQL over typed columns, dense-vector RAG with HNSW cosine search, and a two-stage GraphRAG design. All architectures share the same model and temperature to allow comparison. Results are scored programmatically by an LLM as judge over 20 questions divided across four categories, each question asked three times. GraphRAG solved 16 of 20 questions on all three attempts, compared to 10 for text-to-SQL and 3 for vector RAG. GraphRAG lost on structured aggregation queries. Vector RAG lost the single-document category it was expected to win, passing 3 of 15 where GraphRAG passed 15 of 15, because company attribution is not recoverable from cosine similarity at this scale. All six confident falsehoods in the benchmark were text-to-SQL conflating distinct people who share a surname, the failure that resolving identity to an identifier before reading any text prevents structurally; GraphRAG made none. We claim no advantage beyond this corpus, this model and this question set.
| Subjects: | Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.37728 [cs.IR] |
| (or arXiv:2610.37728v1 [cs.IR] for this version) | |
| https://doi.org/10.48550/arXiv.2610.37728 arXiv-issued DOI via DataCite |
Submission history
From: Fakabbir Amin [view email]
[v1]
Tue, 27 Oct 2026 12:09:48 UTC (44 KB)
来源：arXiv cs.AI · arxiv.org