arXiv cs.AI· Tianyou Lai, Wentao Yue, Hongji Li, Chaoyuan Hao, Qilei Li·· 4 小时前AI 评分31
研究提出修正审计协议:低伤害未必代表更好的概念修正
When Lower Harm Misleads: Auditing Concept Corrections
AI 导读
研究提出“修正审计”评估协议,将每次修正拆分为伤害与有用增益,并在三个乳腺超声数据源上验证:最坏情况修正训练虽降低伤害,却在全部 21 组源对比中损失更多有用增益并抬高修正后 NLL。
正文 · 原文
Abstract:An expert who corrects a concept prediction, such as a BI-RADS descriptor in breast ultrasound, expects the diagnosis to improve. Objectives that reduce the harm of such corrections are judged by harm and accuracy, yet harm also falls when a model responds less to every correction or starts from a worse uncorrected prediction, the reference for harm. We propose a correction audit, a reproducible evaluation protocol that separates these explanations: it splits each correction into harm and useful gain on identical events, separates the starting prediction from the correction response, and compares objectives with amplitude baselines matched in source harm. On three breast-ultrasound sources, worst-case correction training, evaluated from the mean-case model's start, lowers harm but gives up more useful gain in all 21 source comparisons pooled over six seeds, raising the corrected negative log-likelihood (NLL); from the same start, selecting between the objectives by harm picks the less helpful model on all three sources. On CUB, a monotonic harm penalty at its reported weight lowers path-level harm in all 80 concept sets while raising the NLL in all 80, almost entirely before any correction. At a fixed start, rescaling both responses to the same source harm reproduces the penalty's mean harm, useful gain and NLL on single-concept corrections within a prespecified margin of 0.0005 nat, although the two responses point in different directions. Lower harm therefore signals better corrections only when it is read together with useful gain, absolute risk and the start it is measured from.
| Subjects: | Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV) |
| Cite as: | arXiv:2611.22084 [cs.AI] |
| (or arXiv:2611.22084v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.22084 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Tianyou Lai [view email]
[v1]
Tue, 17 Nov 2026 02:10:17 UTC (382 KB)
来源:arXiv cs.AI · arxiv.org