arXiv cs.AI· Damir Shodiev, Nikita Kachaev, Alexey K. Kovalev, Aleksandr I. Panov, Aleksei Staroverov·· 9 天前AI 评分33
VLA Grounder:面向黑盒 VLA 模型的语言条件空间优化
VLA Grounder: Language-Conditioning Space Optimization for Black-Box VLA Models
AI 导读
研究者提出 VLA Grounder,一种语言条件空间策略,将人类指令转换为简短的 VLA 可执行命令,利用物体外观、空间关系和目标定位线索,通过稀疏任务完成奖励的强化学习优化,下游 VLA 保持完全冻结。在 RL4VLA 和 VL-Think 上的实验表明,语言条件空间优化提升了指令敏感、符号化及多物体操作任务的成功率,说明语言可作为机器人基础模型的可优化变量。
正文 · 原文
Abstract:Vision-Language-Action (VLA) models are commonly treated as end-to-end action policies conditioned on natural-language task descriptions. In practice, however, their behavior often depends sharply on how the instruction is phrased, suggesting that language is not merely a task label but an optimizable conditioning input. We study whether frozen VLA policies can be improved by optimizing language space rather than updating action weights. Our method introduces a language-conditioning space policy that translates a human instruction into a short VLA-grounded command using object appearance, spatial relations, and target-grounding cues. The language-conditioning space policy is optimized with reinforcement learning from sparse task-completion rewards, while the downstream VLA remains fully frozen. Experiments on RL4VLA and VL-Think show that language-conditioning space optimization improves success on instruction-sensitive, symbolic, and multi-object manipulation tasks, demonstrating that language can serve as an optimizable variable for robot foundation models.
Website: this https URL
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2607.04517 [cs.AI] |
| (or arXiv:2607.04517v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2607.04517 arXiv-issued DOI via DataCite |
Submission history
From: Aleksei Staroverov [view email]
[v1]
Sun, 5 Jul 2026 21:41:25 UTC (4,408 KB)
[v2]
Wed, 7 Oct 2026 19:59:37 UTC (8,278 KB)
来源:arXiv cs.AI · arxiv.org