arXiv cs.MA· Tushin Mallick, Evan Rose, Matthew Laws, Alina Oprea, Cristina Nita-Rotaru·· 23 小时前AI 评分36
Kaer:面向多智能体系统的安全感知重规划框架
Kaer: Security-Aware Replanning for Multi-Agent Systems
AI 导读
Kaer 是一个带安全感知重规划的多智能体框架,通过抽象模板向重规划流程传递诊断信息,使规划器不直接接触不可信智能体反馈,并将计划修改限制在确定性修复算子内且须满足预设策略。团队构建了针对重规划阶段攻击的 Cintra 基准,在任务完成率与漏洞评估中,Kaer 的鲁棒性高于未设防的 Magentic-One 和当前最优防御 ControlValve,效用与 ControlValve 相当。
正文 · 原文
Abstract:One popular architecture for multi-agent systems (MAS) relies on an orchestrator that generates an initial plan, coordinates its execution, and dynamically revises the plan based on agent feedback when tasks cannot be fully specified in advance. This dynamic replanning introduces a critical vulnerability: malicious agents can embed instructions within their feedback to hijack the replanning process. Existing defenses focus exclusively on per-tool access control or static, pre-execution policy enforcement, leaving the replanning phase unsecured.
We introduce Kaer, a multi-agent framework featuring security-aware replanning. Kaer shields the planner from untrusted agent feedback by conveying diagnostics to the replanning procedure strictly through abstract templates. Plan revisions are restricted to a set of deterministic repair operators, and all modified plans must satisfy preset policies. We create Cintra, a benchmark of simulated user tasks requiring replanning paired with adversarial objectives targeting the replanning phase. Using Cintra, we evaluate both task completion rates and system vulnerability to replanning exploits by malicious agents. Evaluating Kaer on Cintra against Magentic-One (an undefended MAS) and ControlValve (the state-of-the-art defense) demonstrates that Kaer achieves higher robustness than both systems while maintaining comparable utility to ControlValve. Although abstract failure templates slightly constrain utility on select tasks, Kaer enables MAS to perform secure, dynamic plan revisions without exposing the orchestrator to untrusted agent feedback.
| Subjects: | Multiagent Systems (cs.MA); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.24839 [cs.MA] |
| (or arXiv:2611.24839v1 [cs.MA] for this version) | |
| https://doi.org/10.48550/arXiv.2611.24839 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Tushin Mallick [view email]
[v1]
Wed, 18 Nov 2026 18:05:47 UTC (356 KB)
来源:arXiv cs.MA · arxiv.org