跳到正文
arXiv cs.AI· Zongyuan Wu, Xin Wang, Tongtong Feng, Yuan Meng, Zeyang Zhang, Ling Feng, Wenwu Zhu·· 10 小时前AI 评分38

Embodied Graph:面向长时程任务的关系型世界模型

Embodied Graph: A Relational World Model for Long-Horizon Tasks

AI 导读

研究者提出 Embodied Graph 关系型状态抽象与 Relational World Model(RWM),直接在稀疏图状态上进行想象式规划,而非依赖稠密像素观测。

正文 · 原文

View PDF HTML (experimental)

Abstract:Long-horizon tasks in embodied and web environments involve extended decision sequences and delayed feedback, making accurate planning crucial for success. World models tackle this by learning latent dynamics for imagination-based planning. However, existing approaches merely rely on dense pixel-level observations, which forces the model to absorb redundant information while overlooking relations among task-relevant entities. Consequently, small errors may accumulate over long imagined rollouts and gradually corrupt the predictions. In this paper, we explore world models that imagine over sparse state abstractions, which poses two key challenges: 1) how to remove redundant information and form a compact state abstraction; 2) how to incorporate the relational structure to learn reliable long-horizon dynamics. To address these challenges, we propose Embodied Graph, a relational state abstraction that supports structured dynamics modeling and long-horizon imagination, and the Relational World Model (RWM), which performs imagination directly over graph states. RWM consists of (i) a Task-Aware Embodied Graph Constructor that filters redundant details and maintains graph memory through online updates, and (ii) an Embodied Graph Recurrent State Space Model that learns node-wise latent dynamics while capturing inter-node dependencies. The imagined graph states provide predictions of action consequences to guide decision-making. Experiments on Minecraft and Crafter demonstrate the effectiveness of RWM in embodied environments. Notably, in Minecraft, RWM is the only method that obtains diamonds within the given budget. Experiments on web interaction further illustrate the applicability of relational state prediction to the decision making process of web agents.
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.24115 [cs.AI]
  (or arXiv:2611.24115v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2611.24115

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Zongyuan Wu [view email]
[v1] Wed, 18 Nov 2026 09:30:33 UTC (1,188 KB)

来源:arXiv cs.AI · arxiv.org