arXiv cs.CL· Keith Kwok, Wanting Ning, Tej Deep Pala, Desmond C. Ong, S. Supraja, Renwen Zhang, Soujanya Poria·· 13 小时前AI 评分31
TraDE:基于轨迹评估人机对话中的自我披露行为
Beyond Small Talk: Modeling Disclosure Trajectories in Human-AI Conversation
AI 导读
研究者提出 Trajectory-based Disclosure Evaluation(TraDE)评估框架,基于社会渗透理论用预设披露轨迹检验历史披露如何影响模型行为。在多个模型和关系行为基准上,深度相同的披露会因先前轨迹不同而引发不同回应,尤其体现在模型是否接受或质疑用户的表述框架。这些差异与累积的深度披露暴露相关,而非某一刻的脆弱表达或披露顺序,并会在披露回到浅层后持续数轮。
正文 · 原文
Abstract:Recently, we see a rise in conversational agents as a form of social and emotional support, where disclosure will unfold over time. Yet, current evaluations of these agents typically examine isolated conversational states. In analyses of naturally occurring conversations, disclosure history and current disclosure are confounded which tends to make their effects difficult to isolate. We thus introduce Trajectory-based Disclosure Evaluation (TraDE), an evaluation framework grounded in Social Penetration Theory that utilizes predefined disclosure trajectories and evaluates how preceding disclosure history shapes model behavior under matched current disclosure. Through the use of TraDE, we demonstrate across multiple models and relational behavior benchmarks that responses to disclosures matched on depth can differ depending on the preceding trajectory, particularly in whether models accept or challenge the user's framing. We also observed that these differences track accumulated exposure to deeper disclosure rather than any single moment of vulnerability or the order of disclosures. It also tends to persists for several turns after disclosure returns to shallow levels. For several behaviors, we also demonstrate that models diverge most consistently from human supporters in the Emotional Support Conversation corpus (ESConv) not when users open up but rather when they step back in their disclosure. TraDE thus provides a systematic way to expose history-dependent relational behavior that evaluations of isolated conversational states would otherwise miss.
| Comments: | 71 pages, 11 figures. Code available at this https URL |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2610.29413 [cs.CL] |
| (or arXiv:2610.29413v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.29413 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Keith Kwok [view email]
[v1]
Wed, 21 Oct 2026 08:36:47 UTC (3,825 KB)
来源:arXiv cs.CL · arxiv.org