arXiv cs.CY· Nouar AlDahoul, Myles Joshua Toledo Tan, Yasir Zaki·· 12 小时前AI 评分52
研究：真实性标签改变语言模型情感基调，但未消除种族差异
Veracity labels flip the emotional tone of language models but leave racial disparities intact
AI 导读
研究审计了 GPT-5.4 mini、NVIDIA Nemotron 3 Nano、Llama 4 Scout 和 Claude Haiku 4.5 四个模型，发现给虚假标题加上辟谣标签后，GPT、Llama 和 Claude 的情感评分从偏负面转为偏正面，例如 Claude 的“自信”评分从 22% 升至 99.6%，而 Nemotron 的变化较小且方向不一。
正文
Abstract:Large language models (LLMs) increasingly deliver information through personas, but it is unclear whether correcting the facts also makes their framing consistent across identity labels. We audited four LLMs (GPT-5.4 mini, NVIDIA Nemotron 3 Nano, Llama 4 Scout, and Claude Haiku 4.5), which rated simulated affect on six dimensions (mood, anger, fear, confidence, perceived control, and mental state) in response to fact-checked false and true headlines presented without and with a veracity label. Experiment 1 evaluated 1,000 false and 1,000 true headlines without personas; Experiment 2 evaluated 300 of each under 12 personas crossing race, gender, and age. The label strongly changed the emotional tone: ordinal logistic regressions with headline-cluster bootstrap inference showed that refuting false headlines shifted ratings from mostly negative to mostly positive for GPT, Llama, and Claude (e.g., Claude's "confident" ratings rose from 22% to 99.6%), whereas Nemotron showed smaller, mixed shifts, and confirming true headlines produced only small shifts. The label did not, however, remove persona-associated disparities. The models assigned more negative simulated affect to Black than to White personas in 82 of 84 statistically significant comparisons across models and conditions, both without and with the label, and the disparity persisted on headlines unrelated to race; Asian and female personas were also predominantly assigned more negative affect, whereas age effects varied by model and condition. Factual correction and demographic consistency are therefore distinct properties of LLM behavior, and persona-conditioned systems should be audited for both before deployment in sensitive contexts.
| Comments: | 14 pages, 7 figures; Supplementary Information (42 pages, 6 figures, 27 tables) included. Data and code: this https URL |
| Subjects: | Computers and Society (cs.CY); Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.33021 [cs.CY] |
| (or arXiv:2610.33021v1 [cs.CY] for this version) | |
| https://doi.org/10.48550/arXiv.2610.33021 arXiv-issued DOI via DataCite |
Submission history
From: Yasir Zaki [view email]
[v1]
Thu, 8 Oct 2026 18:26:43 UTC (820 KB)
来源：arXiv cs.CY · arxiv.org