arXiv cs.AI· Xuanyi Liu, Ruiqi Li, Siwei Ma·· 2 天前AI 评分30
Mallea：用编码智能体构建、操控与记忆世界
Mallea: Building, Steering, and Memorizing Worlds with Coding Agent
AI 导读
Mallea 是一个从文本构建、操控和记忆世界的系统，由编码智能体从提示词推断物体交互需求，并联合规划物体结构、属性与规则。世界按规划规则演化，用户操作可实时操控，文本请求可编辑属性或扩展能力且保留未受影响的状态。物体纹理记忆仅对白盒定义的物体保留可复用外观，并随物体变化自适应，程序推进世界状态，生成式渲染器结合当前结构与记忆外观输出画面。
正文 · 原文
Abstract:Code world models represent world dynamics through explicit state and executable rules. We investigate how to coordinate object representations, behavioral revisions, and visual memory within this formulation. We present Mallea, a system for building, steering, and memorizing worlds from text. A coding agent infers object interaction requirements from the prompt and jointly plans object structure, properties, and rules, favoring compact representations that support those requirements. The world evolves under the planned rules; optional user actions steer it, while text requests can edit properties or extend capabilities with unaffected state preserved. Object texture memory retains reusable appearance only for whitebox-defined objects and adapts it as those objects change. The program advances world state, while a generative renderer combines current structure with remembered appearance. By organizing construction, intervention, and memory around the same objects, Mallea conditions subsequent observations on the latest state and compatible appearance. Project page: this https URL.
| Subjects: | Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV) |
| Cite as: | arXiv:2610.21283 [cs.AI] |
| (or arXiv:2610.21283v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.21283 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Xuanyi Liu [view email]
[v1]
Thu, 15 Oct 2026 05:24:19 UTC (14,552 KB)
来源：arXiv cs.AI · arxiv.org