arXiv cs.AI· Yepeng Liu, Shengmai Chen, Xuandong Zhao, Chengzhi Liu, Dawn Song, Xin Eric Wang, Yuheng Bu·· 12 小时前AI 评分34
Test-Time Memory Evolution（TTME）能否在科学发现任务上超越 Test-Time Training（TTT）？
Can Test-Time Memory Evolution Outperform Test-Time Training for Scientific Discovery?
AI 导读
研究提出即插即用的测试时自适应方法 Test-Time Memory Evolution（TTME），通过蒸馏经验持续更新外部记忆、不更新模型权重，作为 Test-Time Training（TTT）的替代方案。在相同发现框架下仅替换自适应方法后，TTME 在全部五项数学任务上均优于 TTT，同时 FLOPs 降低 82.8%-84.6%、运行时间缩短 47.7%-58.4%。
正文 · 原文
Abstract:Recent \emph{test-time training} (TTT) frameworks have enabled open-weight large language models (LLMs) to outperform inference-only frameworks powered by frontier models on scientific discovery tasks. However, TTT introduces additional computational cost for online weight updates during the discovery process, making computational efficiency an important consideration when scaling to larger models. This motivates us to explore an efficient \emph{test-time adaptation} method for scientific discovery. We introduce \emph{Test-Time Memory Evolution} (TTME), a plug-and-play test-time adaptation method, as an alternative to TTT. TTME continually updates the external memory by distilling the experience to guide subsequent discovery without updating model weights. To have a clean comparison, we evaluate TTME and TTT under the same discovery framework, replacing only the test-time adaptation method. Our evaluation shows that TTME outperforms TTT on all five mathematical tasks, while reducing computational cost by $82.8$-$84.6\%$ in FLOPs and $47.7$-$58.4\%$ in runtime. These results establish TTME as an effective and computationally efficient alternative to TTT in the evaluated discovery settings.
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.32046 [cs.AI] |
| (or arXiv:2610.32046v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.32046 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yepeng Liu [view email]
[v1]
Fri, 23 Oct 2026 01:37:19 UTC (4,793 KB)
来源：arXiv cs.AI · arxiv.org