arXiv cs.AI· Luca Lusvarghi, Javier Gozalvez·· 10 小时前AI 评分31
注意力不等于相关性:研究质疑自动驾驶中注意力的因果性
Attention Is Not Relevance: Challenging the Causality of Attention in Autonomous Driving
AI 导读
研究基于 PlanT 2.0 在超过 80,000 个合成驾驶场景中对比注意力相关性估计与反事实分析得到的因果参考,发现注意力只提供相关性而非因果性指示。注意力方法无法稳定识别所有相关物体,还会把对驾驶几乎无影响的物体误判为相关;在单车道直路场景中有效,但在多车道道路和交叉路口等复杂场景下准确率下降。
正文 · 原文
Abstract:Attention has become one of the most widely adopted solutions for estimating the relevance of surrounding objects and interpreting an autonomous vehicle's driving decisions. However, its ability to capture the causal impact of individual input elements on an AI model's output has long been discussed in the literature, particularly in the Natural Language Processing (NLP) domain. This work brings this discussion into the autonomous driving domain by analyzing the accuracy of attention in estimating the impact of an input object on an autonomous vehicle's driving, i.e., its relevance. To this end, we compare different attention-based relevance estimation methods against a causal reference of object relevance obtained through counterfactual analysis. We perform our analysis on more than 80,000 synthetic driving scenes using an autonomous vehicle based on PlanT 2.0, a state-of-the-art Transformer-based model for object-level planning. Results show that attention provides a correlational rather than causal indication of object relevance. Attention-based relevance estimation methods do not consistently identify all relevant objects and tend to incorrectly classify as relevant objects with little or no impact on the vehicle's driving. In particular, results show that attention can effectively identify relevant objects in simple single-lane, straight-road scenarios, but its accuracy degrades in more complex settings, such as multi-lane roads and intersections. These findings highlight the limitations of attention as a proxy for object relevance, calling for novel methods able to accurately capture the causal impact of individual objects on the vehicle's driving and distinguish it from correlational associations.
| Subjects: | Artificial Intelligence (cs.AI); Robotics (cs.RO) |
| Cite as: | arXiv:2611.24051 [cs.AI] |
| (or arXiv:2611.24051v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.24051 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Luca Lusvarghi [view email]
[v1]
Wed, 18 Nov 2026 08:42:22 UTC (738 KB)
来源:arXiv cs.AI · arxiv.org