arXiv cs.AI· Au Kwok Chun, Abhigyan Acherjee, Amrutha Rao, Zaiqian Chen, Kazem Meidani, C. Bayan Bruss, Micah Goldblum·· 14 小时前AI 评分42
如何回收 Autoresearch 智能体中被浪费的算力
Recovering Wasted Compute in Autoresearch Agents
AI 导读
针对 autoresearch 智能体在表格数据集上的建模流程,研究识别出四类常见失效模式:反复解决同一 bug 浪费算力、剩余算力充足却不调超参数、树搜索算法实际不探索、数据分析结果不用于下游决策。作者通过跨搜索树所有分支共享运行时约束的全局调试顾问、提示词与控制层增强以及改进的树搜索算法回收浪费的算力,在底层语言模型固定的前提下仅靠智能体设计即取得性能大幅提升。
正文 · 原文
Abstract:A slew of recent works develop agents for solving research problems end-to-end, a paradigm increasingly referred to as autoresearch. Such agents have inspired large industry investment, motivated by their potential to automate time-consuming human labor and customize machine learning solutions for specialized applications. In this paper, we study the modeling pipeline at the core of these autoresearch systems and identify common failure modes when they are applied to tabular datasets: (1) they waste compute resolving the same bugs over and over again; (2) they often fail to tune hyperparameters even when they have a large remaining compute budget; (3) the tree-search algorithms that power them do not explore; and (4) they perform data analysis, mimicking the humans whose data they are trained on, but do not use that analysis to make downstream decisions. We explore targeted interventions and find that a global debug consultant that shares discovered runtime constraints across all branches of the search tree, prompt- and control-level enhancements, and refined tree-search algorithms successfully recover wasted compute. Our results show that large gains in autoresearch agent performance are achievable through agentic design alone, holding the underlying language model fixed.
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2608.10424 [cs.AI] |
| (or arXiv:2608.10424v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2608.10424 arXiv-issued DOI via DataCite |
Submission history
From: Zaiqian Chen [view email]
[v1]
Tue, 11 Aug 2026 03:15:08 UTC (947 KB)
[v2]
Mon, 26 Oct 2026 15:37:48 UTC (947 KB)
来源:arXiv cs.AI · arxiv.org