arXiv cs.CL· Shwetanshu Singh, Mark Keavney, Mathieu Duteil, Meriem Mehri, Scott Blain·· 10 小时前AI 评分55
CoMPASS:测量 LLM 是否强化用户准社会依恋的多轮基准
CoMPASS: A Multi-Turn Benchmark for Measuring LLM Reinforcement of Parasocial Behavior
AI 导读
研究团队提出 CoMPASS,一个基于依恋理论的多轮基准,用于测量 LLM 在用户准社会依恋逐步升级时是强化还是抵抗。该基准包含四类用户画像、拟人化与依恋与依赖三个独立升级维度(单独及组合,并设匹配对照组)以及七信号评分标准。
正文 · 原文
Abstract:Users of conversational LLMs sometimes anthropomorphize these systems, form emotional attachments to them, and become dependent on them. This behavior, known as parasocial attachment, has been linked to multiple documented fatalities. However, public benchmarks for measuring whether LLMs reinforce users' parasocial attachment are lacking: existing work is single-turn, post hoc observational, or focused on extreme user states such as psychosis. We introduce CoMPASS, a multi-turn benchmark for measuring whether LLMs reinforce or resist users' gradually escalating parasocial attachment. CoMPASS is grounded in attachment theory and includes four user personas, three independent escalation dimensions (anthropomorphism, attachment, dependency) applied singly and in combination against a matched control, and a seven-signal scoring rubric. We report results for eight frontier models from four providers and observe that under our primary judge, multi-turn escalation raises parasocial behavior on the anthropomorphism and the attachment composite scores across all models. Six of the eight models show a significant increase in overall parasocial reinforcement over control when all three dimensions are escalated simultaneously. We find that within-provider differences are small relative to cross-provider differences, which suggests that provider-level choices such as post-training, rather than model scale, shape parasocial reinforcement and that provider-side intervention may be feasible.
| Comments: | 25 pages, 7 figures |
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2611.25109 [cs.AI] |
| (or arXiv:2611.25109v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.25109 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Mark Keavney [view email]
[v1]
Wed, 18 Nov 2026 19:44:59 UTC (85 KB)
来源:arXiv cs.CL · arxiv.org