arXiv cs.CL· Diana Turmakhan, Aseem Srivastava, Vivek Gupta, Iryna Gurevych, Thamar Solorio·· 3 天前AI 评分24
SCOUT：面向高效视觉文档检索的级联检索与跨模态查询精炼框架
Cascaded Retrieval with Cross-Modal Query Refinement for Efficient Visual Document Search
AI 导读
研究者提出 SCOUT 级联双轨检索框架，将检索性能与穷举搜索解耦：视觉轨先用轻量父检索器筛选候选池，再对候选应用更强的多向量重排器，语义轨则基于离线生成的层级页面与文档摘要提供互补信号，两者通过跨模态查询精炼融合。
正文 · 原文
Abstract:Retrieving information from visually rich documents requires matching queries against pages that contain complex evidence in tables, figures, and layout-dependent structures. Current vision-language retrievers address this but incur query-time costs that grow with corpus size and are impractical to scale. We propose SCOUT, a cascaded two-track retrieval framework that separates retrieval performance from exhaustive search. The visual track first uses a lightweight parent retriever to filter the corpus to a compact candidate pool, then applies a stronger multi-vector reranker only to those candidates. In parallel, a semantic track retrieves over hierarchical page and document summaries generated offline to provide a signal complementary to visual matching. The outputs are fused through cross-modal query refinement, which uses semantic scores to adjust the visual query representation before final ranking. We evaluate SCOUT on 4 major benchmarks against 6 baselines and observe a significant query-time latency improvement up to 80.7x (28.8x on average) relative to the best baseline, while exceeding state-of-the-art retrieval performance by up to 7.8% NDCG across all benchmarks.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.20367 [cs.CL] |
| (or arXiv:2610.20367v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.20367 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Diana Turmakhan [view email]
[v1]
Wed, 14 Oct 2026 15:40:27 UTC (1,637 KB)
来源：arXiv cs.CL · arxiv.org