arXiv cs.CY· Jie Mao, Pingchen Lu, Xiangyi Wang, Hengquan Huang, Shuang Qiu, Min Zhang, Zhongxiang Dai·· 12 小时前AI 评分31
ID-TAP:面向 LLM 智能体测试时人格化的信息导向对决方法
Bridging Exploration and Persona: Information-Directed Dueling for Test-Time Agent Personalization
AI 导读
ID-TAP 是一个受 IDS 启发的神经对决老虎机框架,用于大规模离散人格空间下的 LLM 智能体测试时人格选择,以候选回复的二元比较作为在线信号。它结合查询条件神经效用模型与轻量 Bradley-Terry 探索器,并通过相似度加权热启动跨相关查询迁移比较证据。在七个用户条件生成基准上,ID-TAP 在固定十轮比较预算内取得所评估基线中最强的综合表现。
正文 · 原文
Abstract:Effective test-time personalization requires LLM agents to adapt to query-dependent user preferences from lightweight interaction. We study persona selection with binary comparisons between candidate responses as the online signal. We present ID-TAP, a scalable, IDS-inspired neural dueling-bandit framework for large discrete persona spaces. ID-TAP combines a query-conditioned neural utility model with a lightweight Bradley-Terry explorer, and transfers comparison evidence across related queries through similarity-weighted warm starts. The neural model shares statistical strength across queries while preserving query-specific scores, and efficient BT updates score hypothetical challengers. Across seven user-conditioned generation benchmarks under reference- and model-based preference simulators, ID-TAP achieves the strongest aggregate performance among the evaluated baselines within a fixed ten-round comparison budget. These results support information-directed challenger selection as an effective design for test-time persona adaptation.
| Subjects: | Artificial Intelligence (cs.AI); Computers and Society (cs.CY) |
| Cite as: | arXiv:2610.24385 [cs.AI] |
| (or arXiv:2610.24385v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.24385 arXiv-issued DOI via DataCite |
Submission history
From: Jie Mao [view email]
[v1]
Sat, 17 Oct 2026 02:40:47 UTC (304 KB)
[v2]
Fri, 23 Oct 2026 08:14:56 UTC (304 KB)
来源:arXiv cs.CY · arxiv.org