arXiv cs.CL· Danyang Zhao, Sendong Zhao, Yanrui Du, Haochun Wang, Ming Ma, Wenhao Li, Jingbo Wang, Jiatong Liu, Bing Qin·· 3 天前AI 评分24
PULSE:面向医学推理的步级检索时机控制方法
Taking the PULSE of Medical Reasoning: Step-Level Retrieval Timing for Knowledge-Grounded Inference
AI 导读
研究者提出 PULSE,一种轻量级探测方法,利用模型内部表征作为步级检索控制信号:错误推理步骤的层间波动显著高于正确步骤,据此训练紧凑探针在每步完成后检测事实错误,并自适应触发检索与步骤重生成。在四个医学基准上,PULSE 定时检索的准确率与逐步穷举检索相当,同时将检索调用减少 72%,并可迁移到未见过的法律领域。
正文 · 原文
Abstract:Reliable medical reasoning requires LLMs to dynamically access external biomedical evidence to improve factual trustworthiness and reasoning accuracy. However, indiscriminate retrieval can introduce noise and latency, raising a critical retrieval-timing problem: at each reasoning step, the system must decide whether the model's internal knowledge is reliable or external evidence is needed. We propose PUlSE, a lightweight probing method that uses the model's internal representations as intrinsic signals for step-level retrieval control. Our posterior trajectory analysis reveals that erroneous steps exhibit substantially higher inter-layer volatility than correct ones, suggesting unstable internal knowledge. Based on this finding, PUlSE trains a compact probe on inter-layer geometric features to detect factual errors upon step completion, and uses it as an adaptive trigger for retrieval and step regeneration. Across four medical benchmarks, PUlSE-timed retrieval matches exhaustive per-step retrieval in accuracy while reducing retrieval calls by 72%, and can transfer to an unseen legal domain, indicating potential domain-agnostic generality. Overall, our study provides an initial step toward shifting retrieval-trigger design from surface-level confidence estimates to internal activation dynamics for adaptive access.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.20292 [cs.CL] |
| (or arXiv:2610.20292v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.20292 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Danyang Zhao [view email]
[v1]
Wed, 14 Oct 2026 14:47:03 UTC (6,462 KB)
来源:arXiv cs.CL · arxiv.org