arXiv cs.AI· Nicolas Martorell, Bruno Bianchi·· 3 天前AI 评分31
别问了：语言模型中的数字自我报告究竟测量了什么
Don't Ask: Understanding What Numeric Self-Reports Measure in Language Models
AI 导读
研究在 8 个指令微调模型上为 wellbeing、interest、focus、impulsivity 四个情感概念训练探针，追踪多轮对话中的状态，并与每轮的数字自我报告对比。结果显示评分问题本身会改变被探测状态，评分与提问前探针分数仅弱相关，与提问后探针关联更强；评分与其它概念探针的关联不亚于其自身概念，且这种耦合与概念特异性均未随 1B-27B 规模提升。
正文 · 原文
Abstract:Language models are often asked to rate their internal states with a number, but it is unclear how reliable this measure is. We train probes for four affective concepts (wellbeing, interest, focus and impulsivity) in eight instruction-tuned models to track these states over multi-turn conversations. We compare each probe's score with a numeric self-report of the same state, elicited at every turn. We find that rating questions displace the probed state, and that the rating is only weakly coupled with the probe score before the question but tracks the post-question probe much more strongly. Steering experiments suggest that models use the affective directions to inform ratings, but that relationship is not specific: ratings are associated with other concepts' probes as much as with their own, and change little when the question is about the user. Finally, neither the pre-question coupling nor concept specificity improves with scale (1B-27B). We warn about the effect a question can have on the internal states one is asking about, and caution against numeric self-report as a reliable measure of those states.
| Comments: | 41 pages, 30 figures, 18 tables. Replaces the preprint "Quantitative Introspection in Language Models: Tracking Emotive States Across Conversation" with an extended, revised study: new title; 8 models (previously 1 in depth, 4 in less detail); 100 conversations (40 previous, 60 new); probe readouts before and after the rating question (previously only after); new controls; revised conclusions |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2603.18893 [cs.AI] |
| (or arXiv:2603.18893v3 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2603.18893 arXiv-issued DOI via DataCite |
Submission history
From: Nicolas Martorell [view email]
[v1]
Thu, 19 Mar 2026 13:33:27 UTC (7,120 KB)
[v2]
Sat, 11 Apr 2026 00:08:59 UTC (7,551 KB)
[v3]
Sat, 10 Oct 2026 21:22:12 UTC (754 KB)
来源：arXiv cs.AI · arxiv.org