arXiv cs.AI· Wen Ye, Yuxiao Qu, Aviral Kumar, Xuezhe Ma·· 6 天前AI 评分22
MIRROR：用跨视图互学提升多模态推理
MIRROR: Learning from the Other View for Multi-Modal Reasoning
AI 导读
研究者提出 MIRROR（Modality-Informed Reciprocal Reasoning Optimization），一种从模型自身不同模态能力中提取跨视图自蒸馏信号的强化学习方法。
正文 · 原文
Abstract:Vision-language models (VLMs) can behave very differently depending on whether the same underlying problem is presented textually or visually. This inconsistency suggests that different views expose different reasoning paths and failure modes that standard multimodal post-training does not fully exploit. To study and exploit this phenomenon, we construct ODA-Data, a high-quality paired multimodal geometry dataset with text-dominant, image-dominant, and combined image+text views of the same problems, together with splits for training and evaluating view dependent reasoning behaviors. We then develop Modality-Informed Reciprocal Reasoning Optimization (MIRROR), a reinforcement learning approach that derives a cross-view self-distillation signal from the model's own modality-dependent capabilities. For each problem, MIRROR evaluates the model under all views, selects the best-performing view as a teacher, and trains the remaining views using a GRPO task-reward objective augmented with a reverse-KL regularizer toward that teacher. Across reasoning benchmarks that evaluate on multimodal mathematics problems, MIRROR improves over standard RL and yields more accurate and consistent behavior across different input modality representations.
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2607.21552 [cs.AI] |
| (or arXiv:2607.21552v2 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2607.21552 arXiv-issued DOI via DataCite |
Submission history
From: Wen Ye [view email]
[v1]
Thu, 23 Jul 2026 17:35:56 UTC (1,531 KB)
[v2]
Thu, 8 Oct 2026 18:38:17 UTC (1,514 KB)
来源：arXiv cs.AI · arxiv.org