跳到正文
arXiv cs.AI· Rukmangadh Sai Myana, Sumit Kumar Jha, Yanzhao Wu·· 10 小时前AI 评分20

熵正则化 Integrated Gradients(ERIG):稳定特征归因的新方法

Entropy-Regularized Integrated Gradients for Stable Feature Attribution

AI 导读

研究者提出熵正则化 Integrated Gradients(ERIG),通过在积分路径上使用带温度参数 τ 的最大熵 softmax 加权来抑制梯度不规则性,从而稳定特征归因。

正文 · 原文

View PDF HTML (experimental)

Abstract:Path-based attribution methods like Integrated Gradients (IG) are widely used to interpret neural networks, yet imperceptible input perturbations can drastically alter their attribution maps while leaving model predictions unchanged. We introduce Entropy-Regularized Integrated Gradients (ERIG), a path-based attribution method that intrinsically attenuates gradient irregularities along the integration path using maximum-entropy softmax weighting with temperature parameter $\tau$. We quantify the effect of the entropy-regularized weighting on attribution stability by using the Lipschitz properties of the model and its gradients. We decompose the attribution change under an input perturbation into a model-response term, whose bound is $\tau$-independent, and a weight-variation term, whose bound decreases at rate $\mathcal{O}(1/(2\tau))$. Their ratio $R(\tau)$ characterizes the trade-off between gradient information and attribution stability. We further add a new dimension to attribution evaluation by adapting classical noise estimators into two metrics, LINV-C and LINV-P, that quantify attribution noise. Across eleven CNN and Transformer backbones on ImageNet and Oxford-IIIT Pet datasets, our experiments show that, relative to the next-best method, ERIG remains comparable on ranking-based fidelity metrics while improving localization by approximately 24% and attribution stability by approximately 47-fold on average, reaching up to four orders of magnitude improvement over IG, all at negligible additional computational cost.
Comments: 36 pages, 19 figures, 27 tables, including the appendix
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2611.23600 [cs.LG]
  (or arXiv:2611.23600v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2611.23600

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Rukmangadh Sai Myana [view email]
[v1] Tue, 17 Nov 2026 22:53:17 UTC (11,540 KB)

来源:arXiv cs.AI · arxiv.org