跳到正文
arXiv cs.CL· Chaewon Heo, Cheyon Jin, Yohan Jo·· 9 小时前AI 评分32

用多样化求助者模拟器压力测试情感支持模型

Stress-Testing Emotional Support Models: Moving from Homogeneous to Diverse Help Seekers

AI 导读

研究团队提出一个由九项心理与语言特征驱动的可控求助者模拟器,基于真实 Reddit 对话并以 MoE 架构训练,将多样化求助行为区分到专门参数子空间。该模拟器在画像遵循度和行为多样性上优于现有方法,并用它评估 7 个主流支持者模型,揭示出此前被掩盖的性能退化。

正文 · 原文

View PDF HTML (experimental)

Abstract:As emotional support chatbots have recently gained significant traction across both research and industry, a common evaluation strategy has emerged: use help-seeker simulators to interact with supporter chatbots. However, current simulators suffer from two critical limitations: (1) they fail to capture the behavioral diversity of real-world seekers, often portraying them as overly cooperative, and (2) they lack the controllability required to simulate specific seeker profiles. To address these challenges, we present a controllable seeker simulator driven by nine psychological and linguistic features that underpin seeker behavior. Using authentic Reddit conversations, we train our model via a Mixture-of-Experts (MoE) architecture, which effectively differentiates diverse seeker behaviors into specialized parameter subspaces, thereby enhancing fine-grained controllability. Our simulator achieves superior profile adherence and behavioral diversity compared to existing approaches. Furthermore, evaluating 7 prominent supporter models with our system uncovers previously obscured performance degradations. These findings underscore the utility of our framework in providing a more faithful and stress-tested evaluation for emotional support chatbots.
Comments: Accepted to Findings of ACL 2026
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2601.07698 [cs.CL]
  (or arXiv:2601.07698v3 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2601.07698

arXiv-issued DOI via DataCite

Submission history

From: Chaewon Heo [view email]
[v1] Mon, 12 Jan 2026 16:30:38 UTC (2,367 KB)
[v2] Sat, 25 Apr 2026 07:05:00 UTC (2,544 KB)
[v3] Tue, 17 Nov 2026 16:37:20 UTC (2,544 KB)

来源:arXiv cs.CL · arxiv.org