arXiv cs.CL· Zhiyun Shi·· 10 天前AI 评分32
Madeleine:从模拟人生中学习对话记忆的非自主回忆
Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives
AI 导读
Madeleine 通过 LLM 人生模拟器离线生成模拟人生,用线索-触发对训练查询编码器,在冻结的相似度之上学习残差关联,在线阶段不调用任何 LLM,仅替换查询编码器即可接入任意向量记忆库。
正文 · 原文
Abstract:A long-term conversational assistant must recall the right memory at the right moment, yet the memory that matters most is often not similar to what the user says now. Current systems recover such associations by letting an LLM reason at write or read time, at a cost of hundreds to over a thousand LLM calls per memory bank and up to several thousand context tokens per query. We argue that association is a learnable relevance: the pointwise mutual information of memories under how human lives unfold. We introduce Madeleine, which learns amortized association: offline, an LLM life simulator writes simulated lives, whose cue-trigger pairs teach a query encoder a residual association on top of frozen similarity; online, it calls no LLM and plugs into any vector memory by replacing only the query encoder. On LoCoMo-Plus under the official protocol, Madeleine (I) reaches 66.6 when plugged into HyperMem, the highest among all systems evaluated under this protocol; (II) used alone, reaches the score of HyperMem as released (52.4 vs. 52.9) with zero LLM calls and about 1/21 of its answer context; and (III) lifts T-Mem by 26.2 points, significantly outperforms the same untrained backbone inside both systems, and leaves ordinary QA intact on the 4B backbone.
| Comments: | 18 pages, 4 figures. v2: adds three-seed results for the HyperMem plug-in and an evaluation with human-written triggers (Appendix D) |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR) |
| Cite as: | arXiv:2610.01118 [cs.CL] |
| (or arXiv:2610.01118v2 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.01118 arXiv-issued DOI via DataCite |
Submission history
From: Zhiyun Shi [view email]
[v1]
Thu, 1 Oct 2026 05:59:23 UTC (1,037 KB)
[v2]
Wed, 7 Oct 2026 12:42:40 UTC (1,029 KB)
来源:arXiv cs.CL · arxiv.org