arXiv cs.AI· Josh Rountree, Pulkit Verma, Oswin So, Chuchu Fan, Julie A. Shah·· 11 小时前AI 评分31
CCW-Net:为深度神经网络模型提供因果概念解释
Causal Concept Explanations for Deep Neural Models
AI 导读
研究者提出 Causal Concept Wrapper Network(CCW-Net),首次将经济学、医学等领域的干预性中介分析用作训练目标,使概念解释与模型输出之间的因果效应对齐。该方法以必要性、充分性和独立性三项反事实概念表示准则约束模型,并可将任一模型输出按概念标签组合量化归因。CCW-Net 已在飞行器控制、驾驶和图像分类任务上评估,论文被 NeurIPS 2026 接收。
正文 · 原文
Abstract:Concept-based explanations in neural models are important for the development, certification, and adoption of autonomous systems. Yet, interpretability remains correlational. Without methods to guide and quantify causal relationships between explanations, a concept explanation can be provided without being necessary or sufficient for the observed output thereby appearing correct while misleading. We introduce Causal Concept Wrapper Network (CCW-Net), the first use of interventional mediation analysis from fields such as economics, medicine, and epidemiology as a training objective to align causal effects of concept-based explanations with a model's output. We further apply mediation analysis as an evaluation tool to quantify, per concept label combination, how much of any model's output is causally attributable to each concept explanation. As a training objective, CCW-Net shapes a model's concept representations such that they are both necessary and sufficient for the outputs they are credited with and independent of other concepts' contributions. Counterfactual concept representations anchor a set of causal alignment criteria: necessity, sufficiency, and independence. Necessity drives irrelevant concept effects toward zero, sufficiency ensures relevant concept representations fully reconstruct a model's output, and independence enforces the total effect decomposes linearly across concepts. We evaluate CCW-Net across aircraft control, driving, and image classification. CCW-Net provides a step toward concept-based explanations that are not merely interpretable, but quantifiably causal, supporting safer evaluation, certification, and deployment of transparent and trustworthy neural models.
| Comments: | Accepted at NeurIPS 2026. 28 pages, 1 figure, 9 tables. Code: this https URL |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.14407 [cs.LG] |
| (or arXiv:2611.14407v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2611.14407 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Josh Rountree [view email]
[v1]
Tue, 10 Nov 2026 17:50:15 UTC (155 KB)
来源:arXiv cs.AI · arxiv.org