arXiv cs.AI· Yunpeng Xiao, Yuzhang Xie, Junhao Huang, Carl Yang, Xiao Hu, Kai Shu·· 10 小时前AI 评分29
基于判别性证据的决策:面向医疗推理的差异化证据框架
Decisions by Discrimination: Differential Evidence for Medical Reasoning
AI 导读
研究者提出一种面向医疗多选题的检索式差异化证据框架,针对每个选项提取专属的判别性证据并组织成简洁的证据提示词用于答案选择,在多个数据集和多个目标 LLM 上取得一致的准确率提升。消融实验显示,该框架优于直接使用检索证据片段和闭源 LLM 生成的通用提示,且提升并非仅由答案邻近性引导解释。该工作已被 AACL 2026 主会接收。
正文 · 原文
Abstract:Large language models (LLMs) are increasingly studied for clinical decision support, and medical question answering provides a testbed for evaluating this capability. In particular, medical multiple-choice questions (MCQs) reflect a core challenge in clinical decision-making: plausible options often share overlapping evidence, while only a few decisive factors distinguish the correct option from incorrect ones. However, existing retrieval-based and reasoning-oriented methods mainly focus on supplying broadly relevant knowledge or eliciting reasoning paths, rather than identifying the compact differential evidence that separates confusing alternatives. In this work, we present a retrieval-grounded differential evidence framework for medical MCQs. Our method extracts option-specific pieces of differential evidence and organizes them into concise evidence prompts for answer selection. This design better aligns external knowledge with differential reasoning while reducing irrelevant context. Experiments show consistent accuracy gains across multiple datasets and target LLMs. Ablation studies further show that our framework outperforms both directly using retrieved evidence chunks and closed-source LLM-generated general hints, and that its improvements are not solely explained by answer-proximal guidance, but are consistent with differential evidence serving as a compact aid for reasoning over competing alternatives. Our findings also offer insights for medical reasoning and other decision-making settings with multiple possible choices.
| Comments: | Accepted by AACL 2026 (main) |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.13233 [cs.AI] |
| (or arXiv:2611.13233v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.13233 arXiv-issued DOI via DataCite (pending registration) |
|
| Journal reference: | Proceedings of AACL-IJCNLP 2026 (Volume 1: Long Papers), pp. 5589-5603, 2026 |
Submission history
From: Yunpeng Xiao [view email]
[v1]
Mon, 9 Nov 2026 21:02:23 UTC (306 KB)
来源:arXiv cs.AI · arxiv.org