arXiv cs.CL· Chongyuan Dai, Yaling Shen, Zirui Song, Junfeng Liao, Jinpeng Hu, Xiuying Chen·· 11 小时前AI 评分34
LExMem:面向长期探索任务的图结构基准与 LExGraph 记忆框架
Twists and Turns: A Graph-Based Benchmark and Framework for Long-Term Memory in Exploration Tasks
AI 导读
研究者提出图引导基准 LExMem,用于评估模型在长期探索任务中的记忆能力,包含 224 段对话和 2,018 个问答实例。配套的 LExGraph 框架将对话增量组织为互联记忆节点,通过混合检索与邻居扩展获取证据,实验表现优于现有检索与记忆系统,并可泛化到外部基准。
正文 · 原文
Abstract:Long-term problem-solving processes, such as scientific research and software development, proceed along an evolving trial-and-error trajectory toward a central goal. We term these \textit{exploration tasks}, which require models to remember not only facts but also how solutions are tested against intermediate outcomes and early attempts are continually revised or revived. However, existing long-term memory research focuses on factual recall and updates, overlooking the interconnected nature of exploration. We observe that exploration processes naturally form graphs, with branching approaches linked by revisions and reconsiderations. Motivated by this, we propose \textsc{LExMem}, a graph-guided benchmark designed to evaluate \underline{\textsc{Mem}}ory in \underline{\textsc{L}}ong-term \underline{\textsc{Ex}}ploration tasks. We model exploration processes as graphs and introduce an evolutionary mechanism to increase their structural complexity, yielding 224 dialogues and 2,018 question-answer instances derived from graph structures. Building on the same insight, we propose \textsc{LExGraph}, a graph-based memory framework that incrementally organizes dialogues into interconnected memory nodes and retrieves evidence through hybrid retrieval and neighbor expansion. Extensive experiments demonstrate that \textsc{LExMem} poses a significant challenge to existing retrieval- and memory-based systems, whereas \textsc{LExGraph} achieves superior performance and generalizes effectively to external benchmarks. Codes and datasets are available at this https URL.
| Comments: | 29 pages, 5 figures |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2611.06414 [cs.CL] |
| (or arXiv:2611.06414v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2611.06414 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Chongyuan Dai [view email]
[v1]
Wed, 4 Nov 2026 12:13:52 UTC (1,186 KB)
来源:arXiv cs.CL · arxiv.org