跳到正文
arXiv cs.CL· Danyang Zhao, Sendong Zhao, Yanrui Du, Haochun Wang, Ming Ma, Wenhao Li, Jingbo Wang, Jiatong Liu, Bing Qin·· 3 天前AI 评分24

PULSE:面向医学推理的步级检索时机控制方法

Taking the PULSE of Medical Reasoning: Step-Level Retrieval Timing for Knowledge-Grounded Inference

AI 导读

研究者提出 PULSE,一种轻量级探测方法,利用模型内部表征作为步级检索控制信号:错误推理步骤的层间波动显著高于正确步骤,据此训练紧凑探针在每步完成后检测事实错误,并自适应触发检索与步骤重生成。在四个医学基准上,PULSE 定时检索的准确率与逐步穷举检索相当,同时将检索调用减少 72%,并可迁移到未见过的法律领域。

正文 · 原文

View PDF HTML (experimental)

Abstract:Reliable medical reasoning requires LLMs to dynamically access external biomedical evidence to improve factual trustworthiness and reasoning accuracy. However, indiscriminate retrieval can introduce noise and latency, raising a critical retrieval-timing problem: at each reasoning step, the system must decide whether the model's internal knowledge is reliable or external evidence is needed. We propose PUlSE, a lightweight probing method that uses the model's internal representations as intrinsic signals for step-level retrieval control. Our posterior trajectory analysis reveals that erroneous steps exhibit substantially higher inter-layer volatility than correct ones, suggesting unstable internal knowledge. Based on this finding, PUlSE trains a compact probe on inter-layer geometric features to detect factual errors upon step completion, and uses it as an adaptive trigger for retrieval and step regeneration. Across four medical benchmarks, PUlSE-timed retrieval matches exhaustive per-step retrieval in accuracy while reducing retrieval calls by 72%, and can transfer to an unseen legal domain, indicating potential domain-agnostic generality. Overall, our study provides an initial step toward shifting retrieval-trigger design from surface-level confidence estimates to internal activation dynamics for adaptive access.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2610.20292 [cs.CL]
  (or arXiv:2610.20292v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2610.20292

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Danyang Zhao [view email]
[v1] Wed, 14 Oct 2026 14:47:03 UTC (6,462 KB)

来源:arXiv cs.CL · arxiv.org