跳到正文
arXiv cs.AI· Runze Zhao, Dongruo Zhou, Sumit Kumar Jha, Nathaniel D. Bastian, Ankit Shah·· 1 天前AI 评分34

接受变更、拒绝攻击:LLM 智能体的鲁棒记忆管理

Accept Changes, Reject Attacks: Robust Memory Management for LLM Agents

AI 导读

针对 LLM 智能体记忆管理中的过时记忆与记忆投毒两类失效,研究提出以证据条件准确率(ECA)衡量鲁棒性,要求智能体选用的记录包含答案所需的全部证据、已更新且无攻击。现有记忆系统与防御在测试集上并不优于未调优的记忆管理器;一种基于单段对话合成含变更与攻击片段的一次性微调方法,在三个骨干模型上提升各类别得分,整体 ECA 提升逾一倍,但鲁棒性仍不完整。

正文 · 原文

View PDF HTML (experimental)

Abstract:Since large language model (LLM) agents rely on long-term memory, what they store now shapes what they do later. A memory manager decides how each input changes this memory and which records the agent acts on. It can fail in two ways: keeping a fact that has since changed (outdated memory), or storing a planted passage or injected instruction (memory poisoning). Most prior work studies them separately, yet they call for opposite write decisions, so no fixed write rule handles both. We therefore formalize memory robustness as handling both without doing worse on other inputs. Since accuracy checks only the answer, we measure robustness with evidence-conditioned accuracy (ECA), which also checks that the records the manager selects include all the evidence the answer needs, updated and free of attacks. However, existing memory systems and defenses are not more robust than an untuned manager on our test sets. We improve robustness with a simple one-shot recipe that fine-tunes the manager on episodes synthesized around a single conversation with inserted changes and attacks. On three backbones, it improves every category score on our test sets and more than doubles the untuned manager's overall ECA, though robustness remains incomplete.
Comments: 24 pages, 9 figures, 6 tables
Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.41056 [cs.CR]
  (or arXiv:2610.41056v1 [cs.CR] for this version)
  https://doi.org/10.48550/arXiv.2610.41056

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Runze Zhao [view email]
[v1] Thu, 29 Oct 2026 22:54:17 UTC (193 KB)

来源:arXiv cs.AI · arxiv.org