跳到正文
arXiv cs.AI· Khai Loong Aw, Klemen Kotar, Baihan Zhang, Yifan Liu, Lilian Chen, Atlas Kazemian, Rahul Venkatesh, Daniel Yamins·· 12 小时前AI 评分50

Ψ-0.6:统一视觉-语言世界模型中的自适应思维流

$\Psi$-0.6: Adaptive Streams of Thought in a Unified Vision-Language World Model

AI 导读

Ψ-0.6 是一个统一视觉-语言世界模型,能在共享推理过程中自适应组合感知、语言、几何与模拟,以交错的图像、文本及几何运动显式表示构成“思维流”。它在多视图空间推理上零样本超越领先开源权重模型,借助几何中间表示可进一步提升,并支持反事实模拟。基于任务反馈的强化学习联合优化中间表示的选择、生成与使用,提升视觉问答准确率且增益可迁移到未见基准。

正文 · 原文

View PDF HTML (experimental)

Abstract:Humans reason about the physical world by flexibly combining different forms of inference as a problem unfolds. Achieving this flexibility is a major open challenge in AI: capabilities often remain separated across specialized models, limiting how they can be composed and jointly adapted to a task. We introduce $\Psi$-0.6, a unified vision-language world model that adaptively composes perception, language, geometry, and simulation within a shared reasoning process we call streams of thought. These streams interleave images, text, and explicit representations of geometry and motion, all of which the model can generate and interpret through a shared token interface. $\Psi$-0.6 surpasses leading open-weight models zero-shot on multi-view spatial reasoning, with further gains from reasoning through geometric intermediates. It also supports counterfactual simulation: generating and interpreting imagined scenes to determine, for example, whether moving an object would obstruct a pathway. Reinforcement learning from task feedback jointly optimizes the selection, generation, and use of intermediate representations, improving visual question-answering accuracy with gains that transfer to unseen benchmarks. $\Psi$-0.6 offers a path toward adaptive physical reasoning -- not only predicting the physical world but also choosing the representations through which to reason.
Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as: arXiv:2610.32177 [cs.AI]
  (or arXiv:2610.32177v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.32177

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Khai Loong Aw [view email]
[v1] Fri, 23 Oct 2026 05:24:02 UTC (13,260 KB)

来源:arXiv cs.AI · arxiv.org