跳到正文
arXiv cs.AI· Hyun Jung Lee, Jungtaek Kim, Jongwon Jeong, Tae-Eui Kam, Donghyun Kim, Yong Jae Lee·· 10 天前AI 评分29

EMHO:通过经验轨迹优化具身智能体框架

EMHO: EMbodied Agent Harness Optimization via Experience Traces

AI 导读

研究者提出 EMHO,一种自进化框架,在保持具身模型冻结的前提下,通过分析执行轨迹和历史框架来迭代修改智能体框架,优化其进度监控、视觉工具使用、观察 grounding 和失败响应方式。

正文 · 原文

View PDF HTML (experimental)

Abstract:Improving embodied agents often focuses on optimizing the underlying model through training, while the surrounding agent harness that controls planning, context, and tool use is typically engineered. We ask whether this harness can instead improve itself directly from experience traces under sparse environmental feedback. We propose EMbodied Agent Harness Optimization (EMHO), a self-evolving framework that keeps the embodied model frozen and iteratively revises its harness by analyzing execution trajectories and prior harness history. EMHO optimizes beyond skills or recovery prompts, modifying how the agent monitors progress, uses vision tools, grounds observations, and responds to failures. To support multiple subtasks with a single harness, we introduce EMHO-Merge, which addresses trade-offs in jointly optimizing a single shared harness across subtasks by using episode-level gains and losses to guide evidence-supported refinement of when and how revised behaviors are applied. We evaluate EMHO on EmbodiedBench across navigation and manipulation tasks, and EMHO consistently improves task success for both Qwen 9B and 27B models. Qualitative analysis shows that EMHO goes beyond recovering from failures and unproductive actions to reshape how the embodied agent interprets and interacts with its environment.
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.08432 [cs.AI]
  (or arXiv:2610.08432v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.08432

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Hyunjung Lee [view email]
[v1] Tue, 6 Oct 2026 14:30:42 UTC (2,263 KB)

来源:arXiv cs.AI · arxiv.org