跳到正文
arXiv cs.AI· Damir Shodiev, Nikita Kachaev, Alexey K. Kovalev, Aleksandr I. Panov, Aleksei Staroverov·· 9 天前AI 评分33

VLA Grounder:面向黑盒 VLA 模型的语言条件空间优化

VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models

AI 导读

研究者提出 VLA Grounder,一种语言条件空间策略,将人类指令转换为简短的 VLA 可执行命令,利用物体外观、空间关系和目标定位线索,通过稀疏任务完成奖励的强化学习优化,下游 VLA 保持完全冻结。在 RL4VLA 和 VL-Think 上的实验表明,语言条件空间优化提升了指令敏感、符号化及多物体操作任务的成功率,说明语言可作为机器人基础模型的可优化变量。

正文 · 原文

View PDF HTML (experimental)

Abstract:Vision-Language-Action (VLA) models are commonly treated as end-to-end action policies conditioned on natural-language task descriptions. In practice, however, their behavior often depends sharply on how the instruction is phrased, suggesting that language is not merely a task label but an optimizable conditioning input. We study whether frozen VLA policies can be improved by optimizing language space rather than updating action weights. Our method introduces a language-conditioning space policy that translates a human instruction into a short VLA-grounded command using object appearance, spatial relations, and target-grounding cues. The language-conditioning space policy is optimized with reinforcement learning from sparse task-completion rewards, while the downstream VLA remains fully frozen. Experiments on RL4VLA and VL-Think show that language-conditioning space optimization improves success on instruction-sensitive, symbolic, and multi-object manipulation tasks, demonstrating that language can serve as an optimizable variable for robot foundation models.
Website: this https URL
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2607.04517 [cs.AI]
  (or arXiv:2607.04517v2 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2607.04517

arXiv-issued DOI via DataCite

Submission history

From: Aleksei Staroverov [view email]
[v1] Sun, 5 Jul 2026 21:41:25 UTC (4,408 KB)
[v2] Wed, 7 Oct 2026 19:59:37 UTC (8,278 KB)

来源:arXiv cs.AI · arxiv.org