arXiv cs.CL· Chaewon Heo, Cheyon Jin, Yohan Jo·· 9 小时前AI 评分32
用多样化求助者模拟器压力测试情感支持模型
Stress-Testing Emotional Support Models: Moving from Homogeneous to Diverse Help Seekers
AI 导读
研究团队提出一个由九项心理与语言特征驱动的可控求助者模拟器,基于真实 Reddit 对话并以 MoE 架构训练,将多样化求助行为区分到专门参数子空间。该模拟器在画像遵循度和行为多样性上优于现有方法,并用它评估 7 个主流支持者模型,揭示出此前被掩盖的性能退化。
正文 · 原文
Abstract:As emotional support chatbots have recently gained significant traction across both research and industry, a common evaluation strategy has emerged: use help-seeker simulators to interact with supporter chatbots. However, current simulators suffer from two critical limitations: (1) they fail to capture the behavioral diversity of real-world seekers, often portraying them as overly cooperative, and (2) they lack the controllability required to simulate specific seeker profiles. To address these challenges, we present a controllable seeker simulator driven by nine psychological and linguistic features that underpin seeker behavior. Using authentic Reddit conversations, we train our model via a Mixture-of-Experts (MoE) architecture, which effectively differentiates diverse seeker behaviors into specialized parameter subspaces, thereby enhancing fine-grained controllability. Our simulator achieves superior profile adherence and behavioral diversity compared to existing approaches. Furthermore, evaluating 7 prominent supporter models with our system uncovers previously obscured performance degradations. These findings underscore the utility of our framework in providing a more faithful and stress-tested evaluation for emotional support chatbots.
| Comments: | Accepted to Findings of ACL 2026 |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2601.07698 [cs.CL] |
| (or arXiv:2601.07698v3 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2601.07698 arXiv-issued DOI via DataCite |
Submission history
From: Chaewon Heo [view email]
[v1]
Mon, 12 Jan 2026 16:30:38 UTC (2,367 KB)
[v2]
Sat, 25 Apr 2026 07:05:00 UTC (2,544 KB)
[v3]
Tue, 17 Nov 2026 16:37:20 UTC (2,544 KB)
来源:arXiv cs.CL · arxiv.org