arXiv cs.AI· Freek Byrman, Partha Das, Stijn Verdenius, Pascal Mettes·· 10 小时前AI 评分31
双曲视觉语言模型到底有多“双曲”？研究发现指数映射近似恒等
How Hyperbolic Are Hyperbolic Vision-Language Models?
AI 导读
研究检验 MERU、HyCoCLIP、ARGENT、PHyCLIP 四个双曲视觉语言模型发现，曲率进入网络的唯一操作指数映射可被恒等函数良好近似，推理时移除该映射评测分数不变。团队从零在 CC3M 上以相同层级损失训练欧氏 VLM，约最后 90% 训练步的统计量与双曲版本几乎无法区分，评测分数和径向分布也一致。结论是欧氏空间足以支撑当前实践的层级视觉-语言学习。
正文 · 原文
Abstract:Hyperbolic vision-language models (VLMs) have emerged as a rapidly growing area of research, reporting strong zero-shot performance alongside an interpretable embedding space in which radius orders representations by generality. But how hyperbolic are hyperbolic VLMs in practice? We investigate this at the exponential map, the single operation through which curvature enters an otherwise Euclidean network. We show that across MERU, HyCoCLIP, ARGENT, and PHyCLIP, the exponential map is well approximated by the identity function, i.e., pairwise distances and angles in the pre-map Euclidean space barely change under projection, and removing the map at inference leaves evaluation scores unchanged. Motivated by this observation, we train Euclidean VLMs on CC3M from scratch under the same hierarchy losses. Over roughly the final 90% of the training steps, the training statistics are nearly indistinguishable from those of their hyperbolic counterparts, and the resulting models match the evaluation scores and recover the same radial distributions. Our findings establish Euclidean space as a sufficient substrate for hierarchical vision-language learning as it is currently practiced, and motivate new paradigms in which hyperbolic geometry can deliver on its theoretical promise. Code is available at this https URL.
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.13384 [cs.CV] |
| (or arXiv:2611.13384v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.13384 arXiv-issued DOI via DataCite (pending registration) |
|
| Journal reference: | Proceedings of the NeurIPS Workshop on Symmetry and Geometry in Neural Representations (NeurReps). PMLR, 2026 |
Submission history
From: Partha Das [view email]
[v1]
Tue, 10 Nov 2026 00:01:33 UTC (917 KB)
来源：arXiv cs.AI · arxiv.org