arXiv cs.CL· Ziheng Chen, Jiali Cheng, Zezhong Fan, Hadi Amiri, Diyuan Wu, Gabriele Tolomei, Yang Zhang·· 12 小时前AI 评分24
TRACER:用 Token 重分配实现生成式推荐中的概念擦除
TRACER: Token ReAssignment for Concept ERasure in Generative Recommendation
AI 导读
TRACER 是一个基于 token 重分配的端到端概念遗忘框架,用于生成式推荐中移除敏感或有害概念。针对 SID 被遗忘项与保留项共享、导致概念移除与推荐效用冲突的问题,它不直接压制共享 SID,而是将概念相关物品重分配到更利于遗忘的替代 token,并引入一致性正则项保持保留项的语义一致性。在真实推荐数据集上,TRACER 有效移除目标概念,且推荐效用保留显著优于现有遗忘基线。
正文 · 原文
Abstract:Generative recommendation formulates next-item prediction as autoregressive generation over semantic ID (SID) sequences derived from users' historical interactions, making modern recommender systems structurally similar to large language models (LLMs). As privacy and safety concerns grow, these systems increasingly require concept unlearning to remove sensitive or harmful concepts associated with items. However, existing LLM unlearning methods cannot be directly applied to generative recommendation. Unlike word tokens with explicit semantics, SIDs are abstract identifiers that are often shared by both forget and retain items, leading to severe conflicts between concept removal and recommendation utility preservation.
To address this challenge, we propose TRACER, an end-to-end concept unlearning framework based on token reassignment. Rather than directly suppressing shared SIDs, TRACER reassigns concept-related items to alternative tokens that better facilitate forgetting while minimizing side effects on retained items. We further introduce a coherence regularizer to preserve semantic consistency among retain items during unlearning. Experiments on real-world recommendation datasets demonstrate that TRACER effectively removes target concepts while substantially better preserving recommendation utility than existing unlearning baselines.
| Comments: | NeurIPS 2026 |
| Subjects: | Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG) |
| Cite as: | arXiv:2606.07688 [cs.IR] |
| (or arXiv:2606.07688v2 [cs.IR] for this version) | |
| https://doi.org/10.48550/arXiv.2606.07688 arXiv-issued DOI via DataCite |
Submission history
From: Jiali Cheng [view email]
[v1]
Fri, 5 Jun 2026 05:19:31 UTC (871 KB)
[v2]
Mon, 2 Nov 2026 15:46:16 UTC (940 KB)
来源:arXiv cs.CL · arxiv.org