跳到正文
arXiv cs.AI· Mario Truss, Marc Schmitt, Stefan Feuerriegel·· 4 小时前AI 评分26

多模态 LLM 生成的解释能否提升 XAI 可视化的感知理解与信任

Can AI Help Explain AI? Effects of Multimodal LLM-Generated Explanations on Perceived Understanding and Perceived Trust in XAI Visualizations

AI 导读

一项预注册的受试者内实验(N=128)覆盖 7 个决策场景和 5 种 XAI 方法,发现加入多模态 LLM 生成的文本解释后,用户感知理解与感知信任在五点量表上分别提升 0.35 和 0.26 分(均 p < .001)。增益在全部 7 个场景中均出现,局部与全局解释之间无差异,且在先前 XAI 接触最少的参与者中最大。中介分析显示,感知理解对感知信任存在间接效应。

正文 · 原文

View PDF HTML (experimental)

Abstract:Explainable artificial intelligence (XAI) aims to make machine learning models understandable, yet many XAI visualizations remain difficult for end-users to interpret. Here, we evaluate whether augmenting XAI outputs with textual explanations from multimodal LLMs improves perceived understanding and perceived trust. We conducted a pre-registered within-subject experiment ($N = 128$) across seven decision scenarios and five XAI methods, with and without LLM generated explanations. The explanations improved perceived understanding and perceived trust by 0.35 and 0.26 points on five-point scales (both $p < .001$). The gain appeared in all seven scenarios, did not differ between local and global explanations, and was largest for participants with the least prior XAI exposure. A mediation analysis indicates an indirect effect on perceived trust through perceived understanding. These results suggest that multimodal LLMs can provide a useful interpretive layer for XAI beyond expert audiences.
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.21638 [cs.HC]
  (or arXiv:2611.21638v1 [cs.HC] for this version)
  https://doi.org/10.48550/arXiv.2611.21638

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Mario Truss [view email]
[v1] Fri, 25 Sep 2026 08:11:14 UTC (7,029 KB)

来源:arXiv cs.AI · arxiv.org