跳到正文
arXiv cs.AI· Hyeseo Jeon, Seonho Yoo, Jay-Yoon Lee·· 12 小时前AI 评分34

GraphRail:用图结构逐步验证搜索智能体的推理错误

Where Search Agents Go Off the Rails: Graph-Grounded Step-Level Verification

AI 导读

GraphRail 将需求、证据与推理表示为结构化声明并直接比对,无需生成式评判器或标准答案,即可检测搜索增强推理系统在中间步骤的错误。在三个多跳 QA 基准和三个推理框架上,其错误召回率优于生成式验证器,且在随机抽取下保持稳定。该诊断还能指导在线推理,提供可追溯的中间错误检测与纠正方式。

正文 · 原文

View PDF HTML (experimental)

Abstract:Search-augmented reasoning systems can reach correct answers while making errors in intermediate steps. Reliable auditing must check whether evidence $D$ covers the question $Q$, reasoning $T$ addresses $Q$, and $T$ is grounded in $D$. We introduce GraphRail, which represents requirements, evidence, and reasoning as structured claims and compares them without a generative judge or gold answer. Across three multi-hop QA benchmarks and three reasoning frameworks, GraphRail improves error recall over generative verifiers while remaining stable under stochastic extraction. Its diagnoses can also guide online reasoning, providing a traceable way to detect and correct intermediate errors.
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.06662 [cs.AI]
  (or arXiv:2611.06662v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.06662

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Hyeseo Jeon [view email]
[v1] Wed, 4 Nov 2026 15:37:36 UTC (317 KB)

来源:arXiv cs.AI · arxiv.org