跳到正文
arXiv cs.AI· Yanbo Wang, Siqi Luo, Siyu Zhang, Chenming Zhu, Wenzhao Zheng, Qian Yu, Juncheng Yan, Bin Fu, Tai Wang, Yu Qiao, Yihao Liu, Jiwen Lu·· 12 小时前AI 评分32

MindView:生成式多视角空间智能基准发布

MindView: Benchmarking Generative Multi-View Spatial Intelligence

AI 导读

研究者推出 MindView 基准,用于评估生成式多视角空间智能,包含来自 513 个场景的 1,500 个样本和七项任务,分为几何主导与语义主导两类。对 11 个生成器的评测显示整体仍有较大提升空间,且在扩展上下文设置下所有模型总分均下降。

正文 · 原文

Authors:Yanbo Wang, Siqi Luo, Siyu Zhang, Chenming Zhu, Wenzhao Zheng, Qian Yu, Juncheng Yan, Bin Fu, Tai Wang, Yu Qiao, Yihao Liu, Jiwen Lu

View PDF HTML (experimental)

Abstract:Spatial intelligence has recently been assessed through generative tasks such as spatially grounded image editing, yet language-guided generation of spatially consistent views from partial multi-view observations remains underexplored. We introduce MindView, a benchmark for generative multi-view spatial intelligence with 1,500 samples from 513 scenes across three indoor datasets. Its seven tasks form two families: geometry-dominant tasks specify changes in camera position and orientation, while semantics-dominant tasks require inferring target viewpoints by grounding referred objects and interpreting spatial relations and reference-frame cues. Evaluation of eleven generators reveals substantial room for improvement on MindView. A paired context analysis further shows that all eleven generators obtain lower overall scores under the expanded context setting. These findings motivate us to investigate whether task-specific supervision can improve target-view generation and whether models can use additional multi-view evidence effectively. We therefore fine-tune BAGEL on the MindView training dataset, improving its overall score by 24.3 points and yielding gains across all seven MindView tasks. Beyond these generation gains, the fine-tuned model also yields higher scores on three spatial-understanding benchmarks without training on their annotations, suggesting that learning to generate spatially grounded views may benefit spatial understanding. To improve evidence utilization under expanded context, we propose MindCue, a training-free spatial evidence selector guided by a target-view hypothesis. MindCue reverses the drop in overall score under expanded context and outperforms the standard-context baseline. Overall, MindView provides a concrete testbed for generative multi-view spatial intelligence.
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.28622 [cs.CV]
  (or arXiv:2610.28622v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2610.28622

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Yanbo Wang [view email]
[v1] Tue, 20 Oct 2026 17:58:25 UTC (10,925 KB)

来源:arXiv cs.AI · arxiv.org