跳到正文
arXiv cs.CL· Yikai Zhu, Kunfeng Chen, Qihuang Zhong, Juhua Liu, Bo Du·· 3 天前AI 评分27

ConRAG:面向多跳问答的共识驱动证据流框架

ConRAG: Consensus-Driven Evidence Flow for Multi-Hop Question Answering

AI 导读

ConRAG 是一个共识驱动证据流框架,通过多视角共识排序筛选相关证据,并用槽位机制在依赖的推理步骤间传递中间信息,以提升 LLM 的多跳问答表现。在三个多跳 QA 基准上,ConRAG 在 Gemma-4-31B-it 上平均分超出最强基线 5.8 分,端到端运行时间和 token 消耗分别降低 75.9% 和 67.3%。

正文 · 原文

View PDF HTML (experimental)

Abstract:Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. However, current multi-hop RAG approaches still struggle with evidence selection and information transfer, i.e., retrieving irrelevant passages or failing to pass intermediate information to subsequent reasoning steps, thereby hindering coherent multi-hop reasoning. To this end, we propose ConRAG, a consensus-driven evidence flow framework that effectively boosts LLM performance on complex multi-hop QA. In short, the core of ConRAG is to select relevant evidence via consensus-driven multi-view ranking, and leverage a slot-based mechanism to transfer intermediate information between dependent reasoning steps. Extensive experiments across three multi-hop QA benchmarks show that ConRAG surpasses the baselines by a clear margin. Encouragingly, on Gemma-4-31B-it, ConRAG outperforms the strongest baseline by 5.8 points in average score, while reducing total end-to-end runtime and token consumption by 75.9% and 67.3%, respectively.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2605.28093 [cs.CL]
  (or arXiv:2605.28093v3 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2605.28093

arXiv-issued DOI via DataCite

Submission history

From: Yikai Zhu [view email]
[v1] Wed, 27 May 2026 07:51:46 UTC (1,243 KB)
[v2] Tue, 9 Jun 2026 08:12:08 UTC (1,243 KB)
[v3] Wed, 14 Oct 2026 16:22:16 UTC (1,230 KB)

来源:arXiv cs.CL · arxiv.org