arXiv cs.AI· Kasra Fallah, Rudramani Singha, Hannah Ghanei, Paul Sajda, James Anderson, Erfan Zabeh·· 11 小时前AI 评分31
通过闭环刺激实现 LLM 的思维控制:分布外鲁棒性
Mind Control of LLMs via Closed-Loop Stimulation: Out-of-Distribution Robustness
AI 导读
研究者将 LLM 引导建模为反馈控制问题,提出基于 $H_\infty$ 的引导控制器,让网络内部状态而非固定干预决定扰动方式,以应对动力学模型与非线性 Transformer 之间的失配。
正文 · 原文
Abstract:Brains and large language models need not be considered equivalent systems to reveal an interpretable commonality: both exhibit high-dimensional, nonlinear dynamics whose behavior can only be modeled imperfectly. This creates a shared challenge whenever we seek to intervene in their dynamics. A controller may either rely on a model identified around a particular operating regime and risk failure as the system moves away from that regime, or explicitly account for uncertainty and a changing internal state. Neurostimulation has confronted an analogous problem for decades. The limitations of fixed, open-loop stimulation have motivated closed-loop and state-dependent approaches that condition intervention on the ongoing state of the neural system. Inspired by this principle, we formulate LLM steering as a feedback-control problem in which the network's internal state, rather than a fixed intervention alone, determines how the system is perturbed. We further account for the mismatch between tractable dynamical models and the nonlinear transformer they approximate through robust control. As one principled realization of this framework, we develop an $H_\infty$-based steering controller that limits sensitivity to disturbances and linearization mismatches. Across multiple steering benchmarks, the controller improves performance over existing baselines, with particularly pronounced gains under out-of-distribution conditions and varying length complexities. Beyond controller performance, we introduce robust steerability, $S_{\mathrm{rob}}$, a pre-deployment measure of tolerance to dynamics mismatch; across model-task pairs, it exhibits task-specific structure and varies systematically with model scale. Beyond robust LLM steering, our measure asks not merely whether control is possible, but how much uncertainty it can survive; a principle that may span artificial and biological neural systems.
| Subjects: | Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Systems and Control (eess.SY) |
| Cite as: | arXiv:2611.06418 [q-bio.NC] |
| (or arXiv:2611.06418v1 [q-bio.NC] for this version) | |
| https://doi.org/10.48550/arXiv.2611.06418 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Erfan Zabeh [view email]
[v1]
Wed, 4 Nov 2026 12:20:00 UTC (11,789 KB)
来源:arXiv cs.AI · arxiv.org