语言模型在偏好认知不确定性下的自适应个性化存在识别-生成差距

View PDF HTML (experimental)

Abstract:Human preferences change over time: an established preference may remain valid over time, become uncertain as context shifts, or be explicitly revised. Effective personalization requires conversational AI to adapt its response strategy to evolving preferences rather than relying on passive memory retrieval. We formalize this capability as adaptive personalization under epistemic uncertainty. A human preference study further confirms that people favor state-contingent response strategies as preference uncertainty changes. To evaluate whether language models mirror this adaptation, we create a multilingual benchmark spanning 250 personas, 5 languages, and 25K conversational turns that decouples strategy selection from response execution. Across eight closed- and open-weight models, we uncover a recognition-generation gap: models reliably identify appropriate strategies when selecting among candidate options, but collapse during open-ended generation, suffering a 35-46% drop in strategy calibration. Crucially, this failure is systematic: models default to exploit-first behavior, over-relying on existing preferences regardless of preference epistemic uncertainty. We show this failure is addressable: while prompting interventions fail, targeted training that supervises models' internal strategy representations toward state-conditional human preferences narrows the user acceptability generalization gap by a third on out-of-distribution personas and conversational styles.

Subjects:	Computation and Language (cs.CL)
Cite as:	arXiv:2610.40930 [cs.CL]
	(or arXiv:2610.40930v1 [cs.CL] for this version)
	https://doi.org/10.48550/arXiv.2610.40930 arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Priyanka Dey [view email]
[v1] Thu, 29 Oct 2026 20:01:11 UTC (1,147 KB)