arXiv cs.AI· Star S. D. Liu, Xiyu Ding, Robert B. Barrett, Alberto Santamaria-Pang, Nic Dobbins, Harold P. Lehmann·· 3 天前AI 评分26
开放权重 LLM 在临床风险分类中的错位与成本不对称
Misaligned Clinical Risk Classification and Cost Asymmetry in Open-Weight Large Language Models
AI 导读
研究考察了 Qwen-2.5-7B/32B 和 Llama-3.1-8B/70B 四款开放权重 LLM 如何在内部表征临床成本权衡。在糖尿病数据集上，患者风险可线性恢复（AUC≈0.83），成本方向在每个模型中均可恢复，但仅两个较大模型的表征偏移与输出变化一致，12 组模型-措辞中仅 2 组同时表现出对 FN 与 FP 成本增加的反向响应及成本正确排序。
正文 · 原文
Abstract:How large language models (LLMs) integrate patient risk with clinical cost tradeoffs remains poorly understood. We investigated how four open-weight LLMs (Qwen-2.5-7B/32B and Llama-3.1-8B/70B) internally represent cost tradeoffs, how these representations relate to clinical predictions, and whether decisions shift as predicted by the specified cost direction and magnitude. Using a public diabetes dataset, we varied 11 false-negative (FN) to false-positive (FP) cost ratios across three phrasings and examined representations and behavioral outputs. Patient risk was linearly recoverable on par with conventional classifiers (AUC $\approx 0.83$), and cost direction was recoverable in every model. However, representational shifts in cost direction tracked output changes only in the two larger models, and responses to cost magnitude were predominantly direction-agnostic. Only 2 of 12 model-phrasings showed both opposing responses to increasing FN versus FP costs and cost-correct ordering. Representationally, a direction fitted on one cost side did not invert when transferred to the other, as expected under mirror-symmetric encoding. These findings suggest that LLMs encode risk and cost information but do not reliably integrate them into cost-correct decisions. Clinical evaluations should therefore include tradeoff tests, phrasing sensitivity, and default operating points alongside predictive performance.
| Comments: | Submitted to ML4H 2026 |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2609.23999 [cs.LG] |
| (or arXiv:2609.23999v3 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2609.23999 arXiv-issued DOI via DataCite |
Submission history
From: Star S.D. Liu [view email]
[v1]
Mon, 21 Sep 2026 02:02:10 UTC (4,937 KB)
[v2]
Mon, 28 Sep 2026 03:06:45 UTC (4,937 KB)
[v3]
Tue, 13 Oct 2026 04:26:41 UTC (5,622 KB)
来源：arXiv cs.AI · arxiv.org