跳到正文
arXiv cs.CL· Austin C. Kozlowski, Avital Mintz, Madison Lee·· 12 小时前AI 评分49

Persona Perspectives:让 LLM 采用视角会重组其内部表征

Persona Perspectives: Adopting Viewpoints Reorganizes Representations in LLMs

AI 导读

研究发现,提示 LLM 采用自由派或保守派政治人格后,其潜空间中 9,000 多个常用词和 33 条语义轴的投影与轴间对齐会系统性偏移,方向与指定意识形态一致。

正文 · 原文

View PDF HTML (experimental)

Abstract:Common methods for monitoring features in large language models (LLMs) such as linear probes and sparse autoencoders (SAEs) assume that features maintain a consistent representation across contexts. LLMs, however, can flexibly adopt different perspectives or "personas" that suggest different underlying systems of conceptual relations. In this paper, we examine whether prompting an LLM to adopt a persona alters the representational geometry of the model's latent space. We extract representations of over 9,000 common words and 33 semantic axes from models adopting liberal and conservative political personas and compare these against two neutral baselines. We find that persona conditioning systematically alters both the projections of words onto semantic axes and the alignments among the axes themselves in directions consistent with the specified ideology. We then test the implications of this reorganization for two safety-relevant features: truthfulness and morality. Linear probes, SAE-based classifiers, and classifiers built from manually selected word representations, all trained without a persona, produce divergent results when applied to models conditioned on political personas, producing politically slanted ratings of truth and morality on controversial statements. These findings suggest that internal representations, as they are conventionally extracted, can exhibit different geometric relations when the model adopts personas, potentially undermining monitoring efforts.
Comments: 26 pages, 14 figures
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2611.06848 [cs.CL]
  (or arXiv:2611.06848v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2611.06848

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Austin Kozlowski [view email]
[v1] Wed, 4 Nov 2026 18:05:17 UTC (1,068 KB)

来源:arXiv cs.CL · arxiv.org