LLM 如何编码并调节一元先验：unembedding 中的“无知方向”

View PDF HTML (experimental)

Abstract:What does a language model predict when it has few clues?The answer lies in its unembedding geometry: a single direction of the unembedding matrix encodes the unigram distribution of the training corpus, which serves as the Bayesian prior the model falls back on when uncertain. This structure, termed the direction of ignorance, appears across all model families examined (Llama, Qwen, Gemma, and Pythia), ranging from 0.4B to 405B parameters. Projecting the final prediction state onto this direction yields a per-token prior loading factor $\lambda$, which declines steadily as the context becomes more informative. Formally, the same projection decomposes the prediction state into two orthogonal vectors interpretable as the two components of a tempered Bayesian update: a unigram prior raised to the exponent $\lambda$ and a context-driven likelihood. This geometric probabilistic connection makes $\lambda$ meaningfully comparable across model sizes and families. Larger models generally exhibit lower prior reliance, and reasoning models exhibit lower reliance than their base counterparts. Finally, we show that $\lambda$ serves as a causal, inference-time control: reducing it can promote context-driven continuations and improve Llama-3.2-3B-Instruct on GSM8K, whereas amplifying it or applying matched perturbations along random directions degrades performance.

Subjects:	Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)
Cite as:	arXiv:2609.02959 [cs.LG]
	(or arXiv:2609.02959v2 [cs.LG] for this version)
	https://doi.org/10.48550/arXiv.2609.02959 arXiv-issued DOI via DataCite

Submission history

From: Jianbang Liu [view email]
[v1] Wed, 2 Sep 2026 05:05:50 UTC (6,122 KB)
[v2] Thu, 29 Oct 2026 05:14:41 UTC (9,323 KB)