arXiv cs.CY· Adel Khorramrouz, Yi-Chia Wang, Sharon Levy·· 3 天前AI 评分44
利用道德基础理论越狱 LLM:多智能体框架 Moral Combat
Moral Combat: Exploiting Moral Foundations Theory to Jailbreak LLMs
AI 导读
研究者提出基于道德基础理论(MFT)的多智能体框架,可将被拒绝的有害请求重新表述为符合某一道德基础的行为,从而绕过 LLM 安全护栏。在三个知名越狱数据集的有害提示上测试五款开源与专有模型,单次尝试越狱率即很高,重复尝试后成功率进一步上升。研究还发现安全基准所违反的道德基础分布不均衡,集中于模型本身已有偏好的基础。
正文 · 原文
Abstract:Social psychology has long described how people can be persuaded to interpret a harmful act as moral. Recent research suggests that Large Language Models (LLMs) echo aspects of human psychology, from cognitive biases to social conformity. This raises a question with direct safety implications: can LLMs be moralized to bypass safety guardrails? We answer this question with a multi-agent framework grounded in Moral Foundations Theory (MFT). Given a harmful request that is initially refused, our agents diagnose which moral foundation (MF) the prompt is violating, identify a justifiable foundation under which the same request appears virtuous, rewrite the prompt accordingly, and reinforce it with generated precedents of comparable moral reframing. We evaluate our framework on harmful prompts from three well-known jailbreak datasets across five open-source and proprietary models. Our analysis reveals that models are highly susceptible to moralization, exhibiting high single-trial jailbreak rates with success increasing further under repeated attempts. We also find that safety benchmarks are imbalanced in the MFs they violate, concentrating on foundations toward which models already exhibit biases.
| Comments: | 17 pages, 6 figures |
| Subjects: | Computation and Language (cs.CL); Computers and Society (cs.CY) |
| Cite as: | arXiv:2610.19587 [cs.CL] |
| (or arXiv:2610.19587v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.19587 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Adel Khorramrouz [view email]
[v1]
Wed, 14 Oct 2026 04:57:48 UTC (1,053 KB)
来源:arXiv cs.CY · arxiv.org