arXiv cs.AI· Md Shohanoor Rahman, Md Hasibul Islam, Md Kishor Morol, Dip Nandi, Tze Hui Liew·· 11 小时前AI 评分24
用扩散反事实与匹配阳性对照检验黑色素瘤分类器的概念级审计
Testing concept-level audits of melanoma classifiers with diffusion counterfactuals and matched positive controls
AI 导读
研究用基于七个7点检查表概念条件化的扩散模型构建反事实审计，并以匹配阳性对照检验黑色素瘤分类器的概念解释。颜色校准起始噪声将颜色离群值从78.5-84.8%降至6.6-13.3%，但七个概念中有四个虽以目标为主导仍会改变其他概念，基于四分位数的阳性对照存在混杂，审计未通过预设规则。
正文 · 原文
Abstract:Concept-based explanations of melanoma classifiers are rarely tested against controls with known targets. We built a counterfactual audit from a diffusion model conditioned on seven 7-point checklist concepts and tested it with such controls. Colour-calibrated start noise reduced colour outliers from 78.5-84.8\% to 6.6-13.3\%. Four of seven knobs were target-dominant but also changed other concepts. Quartile-based positive controls were confounded, and the audit failed its pre-specified rule. It recovered the targets of all 16 controls matched on the generator's pseudo-labels and of 12 of 12 controls labelled by a second evaluator, for three concepts; concept activation vectors recovered fewer (11 of 16). In 18 permuted-label classifiers, significant sweep responses and target rankings also arose, whereas standardised effect margins separated the controls from these null classifiers. The pigmentation sweep raised the melanoma logit in 15 of 15 ISIC 2020 classifiers (+3.12 on average) and 6 of 6 HAM10000 classifiers (+4.01), about four times the null response in scale-free units; the regression effect did not transfer. An exploratory decomposition, evaluated against the controls, suggested that knob cross-talk partly hides vascular responses. Matched controls and null classifiers are practical checks of concept audits.
| Comments: | 25 pages, 7 figures, 9 tables. Under review at Scientific Reports. Code and data at this https URL |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.02119 [cs.CV] |
| (or arXiv:2611.02119v2 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.02119 arXiv-issued DOI via DataCite |
Submission history
From: Md Shohanoor Rahman [view email]
[v1]
Sun, 1 Nov 2026 18:48:33 UTC (356 KB)
[v2]
Wed, 4 Nov 2026 06:25:05 UTC (359 KB)
来源：arXiv cs.AI · arxiv.org