论文主张智能体安全应作为系统问题处理

Authors:Mihai Christodorescu, Earlence Fernandes, Ashish Hooda, Somesh Jha, Johann Rehberger, Kamalika Chaudhuri, Xiaohan Fu, Khawaja Shams, Guy Amir, Jihye Choi, Sarthak Choudhary, Nils Palumbo, Andrey Labunets, Nishit V. Pandya

View PDF HTML (experimental)

Abstract:We take the position that agent security must be approached as a systems problem: the AI model powering the agent must be treated as an untrusted component, and security invariants must be enforced at the system level. Through this lens, efforts to increase model robustness (the dominant viewpoint in the community) are insufficient on their own. Instead, we must complement existing efforts with techniques from the systems security domain. Based on our experience as cybersecurity researchers in operating systems, networks, formal methods, and adversarial machine learning, we articulate a set of core principles, grounded in decades of systems security research, that provide a foundation for designing agentic systems with predictable guarantees. As evidence, we analyze eleven representative real-world attacks on agents and discuss how systems principles, if realized, could have prevented these attacks. We also identify the research challenges that stand in the way of implementing these principles in agents.

Comments:	Accepted to NeurIPS 2026 (Oral Presentation)
Subjects:	Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI)
Cite as:	arXiv:2605.18991 [cs.CR]
	(or arXiv:2605.18991v3 [cs.CR] for this version)
	https://doi.org/10.48550/arXiv.2605.18991 arXiv-issued DOI via DataCite

Submission history

From: Nils Palumbo [view email]
[v1] Mon, 18 May 2026 18:11:17 UTC (9,744 KB)
[v2] Wed, 20 May 2026 17:25:38 UTC (9,744 KB)
[v3] Wed, 4 Nov 2026 00:02:12 UTC (9,749 KB)