跳到正文
arXiv cs.CL· Mingchen Li, Yongkang Xiao, Rumeng Li, Rui Zhang, Hong Yu·· 10 小时前AI 评分34

BioMem:面向生物医学 LLM 智能体的智能体记忆系统

BioMem: Agentic Memory for Biomedical LLM Agents

AI 导读

研究系统评估了生物医学领域智能体记忆系统,在生物医学知识推理、临床预测和长期对话记忆三类场景下,测试了 5 种记忆方法与 4 个 LLM 的组合表现。基于分析结果提出免训练框架 HMRU,在生物医学问答与对话记忆基准上平均相对提升 8.6%,对话回答错误率降低 24.9%,并将与全上下文推理的性能差距缩小 48.0%。

正文 · 原文

View PDF HTML (experimental)

Abstract:Large language models (LLMs) have demonstrated considerable potential in biomedical applications, while agentic memory systems have emerged as a promising approach to preserving and utilizing information across tasks and interactions. However, a fundamental question remains: how effectively and reliably do these systems retain, retrieve, update, and utilize biomedical information? In this study, we systematically investigate agentic memory in the biomedical domain, focusing on task effectiveness, retrieval quality, information fidelity, and long-term robustness. We evaluate five memory approaches across four LLMs in three representative settings: biomedical knowledge reasoning, clinical prediction, and long-term conversational memory. Our analyses reveal how memory construction, evidence relevance, and conversational history shape downstream biomedical performance, highlighting the distinct challenges of retrieving relevant information, preserving its fidelity, and effectively utilizing it for reasoning. Building on these findings, we introduce Hybrid Memory Retrieval and Utilization (HMRU), a training-free framework that jointly enhances evidence accessibility and task-aware utilization to improve biomedical reasoning and long-term conversational memory. HMRU achieves an average relative improvement of 8.6% across biomedical question-answering and conversational memory benchmarks, with additional gains in selected clinical prediction tasks. It further reduces conversational answer errors by 24.9% and closes 48.0% of the performance gap to full-context inference. Our findings provide a systematic characterization of biomedical agentic memory and practical insights into developing more effective and reliable memory-augmented LLM systems.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2611.13426 [cs.CL]
  (or arXiv:2611.13426v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2611.13426

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Mingchen Li [view email]
[v1] Tue, 10 Nov 2026 01:09:11 UTC (336 KB)

来源:arXiv cs.CL · arxiv.org