arXiv cs.AI· Diksha Gupta, Rieke Fruengel, Stefan Heimersheim·· 14 小时前AI 评分26
语言模型中的星期流形并非连续圆环，而是七个离散状态
Spokes, not a Ring: Revisiting the Weekday Manifold in Language Models
AI 导读
研究检验了语言模型中星期概念的连续流形假设，发现其表示更像排列成圆形的七个离散状态而非连续圆环。局部敏感性存在七个与星期对齐的极小值，沿流形引导时表示与行为呈阶梯式映射；时刻、不确定性及自然文本均未填充中间空间。结果挑战了星期流形的连续解读，并提示需检验其他表示流形上的移动是否对应有意义的变化。
正文 · 原文
Abstract:Recent work has hypothesised that large language models may represent some concepts as multi-dimensional manifolds instead of single directions. Using these manifolds to interpret or steer representations often assumes that moving along them corresponds to a continuous change in the represented concept. In this work, we test this continuous manifold assumption on the prototypical weekday manifold. Despite its striking circular geometry, we find that the weekday representations behave more like seven discrete states arranged in a circle than a continuous ring. First, we show that local sensitivity has seven minima aligned with the weekdays, producing a step-like mapping between representation and behaviour under on-manifold steering. Second, we test whether any concepts are represented along the manifold outside the seven discrete states, and find neither time of day, uncertainty, nor natural text populate the intermediate space. Together, these results challenge the continuous interpretation of the weekday manifold and motivate testing whether movement along other representation manifolds correspond to meaningful changes in model representations and behaviour.
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.37796 [cs.LG] |
| (or arXiv:2610.37796v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.37796 arXiv-issued DOI via DataCite |
Submission history
From: Diksha Gupta [view email]
[v1]
Tue, 27 Oct 2026 18:15:59 UTC (3,829 KB)
来源：arXiv cs.AI · arxiv.org