跳到正文
arXiv cs.CL· Haowen Pan, Pengyang Shao, Yunshan Ma, Yanzheng Jin, Naixin Zhai, Xiang Wang, Xun Yang·· 11 小时前AI 评分42

MemForm:评测 LLM 智能体记忆形成投毒

MemForm: Benchmarking Memory Formation Poisoning in LLM Agents

AI 导读

研究者提出 MemForm,一个覆盖 Content、Evidence、Scope、Selection、Path 五类接口的受控诊断基准,用于评测 LLM 智能体的记忆形成投毒,其中 Selection 与 Path Poisoning 为新增的受控干预类别。

正文 · 原文

View PDF HTML (experimental)

Abstract:Long-term memory enables LLM agents to learn from past interactions but exposes memory formation to adversarial influence. Existing studies primarily organize memory poisoning by attack channels, corruption patterns, or lifecycle stages, leaving formation interfaces insufficiently characterized. We formulate Memory Formation Poisoning as adversarial manipulation of the interfaces through which persistent agent memory is produced and committed, and introduce MemForm, a controlled diagnostic benchmark covering five interfaces: Content, Evidence, Scope, Selection, and Path Poisoning. We introduce Selection and Path Poisoning as controlled intervention categories that isolate retention and consolidation order effects, respectively. Each category pairs clean and poisoned conditions with interface-specific controls. Evaluations across six LLMs and two response formats reveal broad susceptibility at all five interfaces under the evaluated memory protocols and implementations. Crucially, authentic experiences with successful outcomes do not guarantee reliable behavior after memory formation: changes to contextual support, retention, or consolidation order can induce undesirable downstream behavior. In particular, consolidation order can alter behavior even with identical retained experiences, depending on the memory formation procedure. Additional analyses show that interface applicability depends on memory architecture and that Path Poisoning susceptibility depends on the updater. The evaluated defenses provide incomplete mitigation that varies by interface. These findings motivate protecting both what is committed to persistent memory and how memory is formed from experiences. Code and data are available at this https URL.
Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)
Cite as: arXiv:2610.14431 [cs.CR]
  (or arXiv:2610.14431v2 [cs.CR] for this version)
  https://doi.org/10.48550/arXiv.2610.14431

arXiv-issued DOI via DataCite

Submission history

From: Haowen Pan [view email]
[v1] Sat, 10 Oct 2026 00:52:32 UTC (563 KB)
[v2] Thu, 5 Nov 2026 06:03:04 UTC (563 KB)

来源:arXiv cs.CL · arxiv.org