arXiv cs.AI· Jiaoyang Ruan, Xin Gao, Yinda Chen, Hengyu Zeng, Liang Du, Guanghao Li, Jie Fu, Jian Pu·· 11 小时前AI 评分31
扩散语言模型推理新方法：双向流形一致性实现自验证
Reasoning on the Manifold: Bidirectional Consistency for Self-Verification in Diffusion Language Models
AI 导读
研究者提出 Bidirectional Manifold Consistency（BMC），一种无需训练、无监督的度量，通过前向掩码与后向重建循环量化扩散大语言模型（dLLM）生成序列的稳定性。BMC 可用于无标准答案时判别解答有效性、推理阶段拒绝重采样以集中算力，以及作为稠密几何奖励将稀疏结果监督转为细粒度引导。该工作已被 ICML 2026 接收。
正文 · 原文
Abstract:While Diffusion Large Language Models (dLLMs) offer structural advantages for global planning, efficiently verifying that they arrive at correct answers via valid reasoning traces remains a critical challenge. In this work, we propose a geometric perspective: Reasoning on the Manifold. We hypothesize that valid generation trajectories reside as stable attractors on the high-density manifold of the learned distribution, whereas invalid paths exhibit off-manifold drift. To operationalize this, we introduce Bidirectional Manifold Consistency (BMC), a training-free, unsupervised metric that quantifies the stability of the generated sequence through a forward-masking and backward-reconstruction cycle. Empirically, we demonstrate BMC's versatility across the full reasoning lifecycle: (1) in Diagnosis, it serves as a robust discriminator of solution validity without ground truth answer; (2) in Inference, it enables rejection resampling to effectively concentrate computational resources on complex reasoning tasks; and (3) in Alignment, it functions as a dense geometric reward that transforms sparse outcome supervision into fine-grained guidance, empowering models to self-evolve beyond standard baselines. Our results establish intrinsic geometric stability as a robust indicator of correctness for dLLMs.
| Comments: | 31 pages, 7 figures. Accepted to the 43rd International Conference on Machine Learning (ICML 2026). Camera-ready version |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2604.16565 [cs.LG] |
| (or arXiv:2604.16565v4 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2604.16565 arXiv-issued DOI via DataCite |
|
| Journal reference: | Proceedings of the 43rd International Conference on Machine Learning, PMLR 306, 2026 |
Submission history
From: Jiaoyang Ruan [view email]
[v1]
Fri, 17 Apr 2026 10:17:16 UTC (788 KB)
[v2]
Thu, 23 Apr 2026 12:41:25 UTC (788 KB)
[v3]
Wed, 27 May 2026 14:55:17 UTC (789 KB)
[v4]
Thu, 5 Nov 2026 12:30:15 UTC (786 KB)
来源：arXiv cs.AI · arxiv.org