arXiv cs.CL· Mehrdad Ghassabi, Audrina Ebrahimi, Sadra Hakim, Hamidreza Baradaran Kashani, Zahra Zojaji, Amin Milani Fard·· 9 小时前AI 评分37
检测到投毒不等于能抵抗:RAG 中的推理与投毒上下文
When Detection Does Not Guarantee Resistance: Reasoning and Poisoned Context in RAG
AI 导读
在 200 道 SciFact 问题上对比 DeepSeek-V4-Flash 与 Qwen3.6-Plus 的推理开关配置后发现,开启推理让 DeepSeek-V4-Flash 的 Cordon Rate 从 0.205 降至 0.075。
正文 · 原文
Abstract:Retrieval-Augmented Generation (RAG) exposes large language models to knowledge-poisoning attacks, where misinformation injected into retrieved documents can influence model outputs. Prior work has shown that models may detect contradictory evidence yet still allow it to influence their responses, revealing a gap between monitoring and control. We investigate whether deliberative reasoning changes this relationship. Because attack success and poison detection alone do not reveal whether detected poison continues to influence the final answer, we use two complementary measures: Cordon Rate, the probability that a model detects poison and nevertheless produces a poison-aligned answer, conditioned on a non-poison-aligned no-RAG response; and Leakage Rate, the probability that poisoned context influences the answer despite an explicit instruction to ignore retrieved documents. Across 200 SciFact questions, we compare reasoning-disabled and reasoning-enabled configurations of DeepSeek-V4-Flash and Qwen3.6-Plus. For DeepSeek-V4-Flash, reasoning reduces Cordon Rate from 0.205 to 0.075 and Leakage Rate from 0.235 to 0.140, despite increasing Attack Success Rate from 0.233 to 0.298 and decreasing Poison Detection Rate from 0.965 to 0.665. Qwen3.6-Plus shows the same qualitative pattern. These results demonstrate that poison detection and downstream influence capture distinct aspects of poisoning behavior.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2608.17153 [cs.CL] |
| (or arXiv:2608.17153v5 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2608.17153 arXiv-issued DOI via DataCite |
Submission history
From: Mehrdad Ghassabi [view email]
[v1]
Mon, 17 Aug 2026 21:37:20 UTC (26 KB)
[v2]
Wed, 16 Sep 2026 22:08:55 UTC (26 KB)
[v3]
Sat, 19 Sep 2026 16:12:50 UTC (26 KB)
[v4]
Wed, 30 Sep 2026 23:12:12 UTC (29 KB)
[v5]
Tue, 17 Nov 2026 15:58:49 UTC (29 KB)
来源:arXiv cs.CL · arxiv.org