arXiv cs.CL· Wenyuan Li, Guang Li, Dongyuan Li, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama·· 11 小时前AI 评分34
HSC-Bench：评估 AI 智能体任务交接中的任务接管能力
Benchmarking Task Takeover Across Agent Handoffs
AI 导读
研究者提出 Handoff State Continuity Benchmark（HSC-Bench），包含 1,039 个任务，用于评估接收模型在智能体交接后恢复仓库证据与延续既有对话、工具和文件工作状态的能力。对六个接收模型的对比显示，结构化交接状态能提升所有模型的仓库证据恢复表现，并改善多数模型的延续表现；两条评估轨道上的最强模型并不相同，说明仅凭证据恢复排名无法刻画继承状态后的延续能力。
正文 · 原文
Abstract:As agents collaborate on longer tasks, responsibility may pass between models before the work is complete. The receiving model must build on prior decisions, observations, and actions while addressing the remaining requirements. Evaluating this transition requires connecting the information preserved at handoff to how the receiver continues the work, a relationship that task-success and memory-retention scores alone do not capture. We introduce the Handoff State Continuity Benchmark (HSC-Bench), comprising 1,039 tasks that evaluate two complementary aspects of task takeover: recovering relevant repository evidence and continuing from established conversational, tool, and file-work state. Comparisons across six receiving models show that structured handoff state improves repository evidence recovery for every model and continuation performance for most models. The strongest receivers differ between the two tracks, showing that evidence-recovery rankings alone do not characterize performance when continuing from inherited state. By combining these comparisons with checks of subsequent responses and actions, HSC-Bench evaluates both access to prior evidence and adherence to established commitments and completed work. This provides a basis for selecting receiving models and assessing handoff representations according to the work that must be carried forward.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.36523 [cs.CL] |
| (or arXiv:2610.36523v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.36523 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Guang Li [view email]
[v1]
Tue, 27 Oct 2026 02:27:04 UTC (950 KB)
来源：arXiv cs.CL · arxiv.org