跳到正文
arXiv cs.AI· Alexander Loth, Martin Kappes, Marc-Oliver Pahl·· 14 小时前AI 评分31

工业化欺骗:LLM 生成虚假信息对数字生态的连带影响

Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems

AI 导读

研究提出 JudgeGPT 与 RogueGPT 两个工具,构成研究人类如何感知和检测 AI 生成虚假信息的实验流水线。作者指出 LLM 与多模态系统让 AI 生成内容质量提升,检测能力虽有改善,但生成与检测之间的竞争仍在持续。缓解策略包括基于 LLM 的检测与“接种”式干预,并讨论了生成式 AI 的两用性质。

正文 · 原文

View PDF HTML (experimental)

Abstract:Generative AI and misinformation research have evolved since our 2024 survey. This paper presents an updated perspective, transitioning from literature review to practical countermeasures. We report on changes in the threat landscape, including improved AI-generated content through Large Language Models (LLMs) and multimodal systems - addressing the adverse impacts of AI on information quality.
This work focuses on our practical contributions: JudgeGPT, a platform to evaluate human perception of AI-generated news, and RogueGPT, a controlled stimulus generation engine for research. Together, these tools form an experimental pipeline for studying how humans perceive and detect AI-generated misinformation.
Our findings show that detection capabilities have improved, but competition between generation and detection continues. We discuss mitigation strategies such as LLM-based detection, inoculation approaches, and the dual-use nature of generative AI.
Comments: 8 pages, 2 figures. Published in the Companion Proceedings of the ACM Web Conference 2026 (WWW Companion '26), pp. 295-302
Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Social and Information Networks (cs.SI)
ACM classes: I.2.7; K.4.1; K.4.2; H.3.5
Cite as: arXiv:2601.21963 [cs.CY]
  (or arXiv:2601.21963v3 [cs.CY] for this version)
  https://doi.org/10.48550/arXiv.2601.21963

arXiv-issued DOI via DataCite

Journal reference: Companion Proceedings of the ACM Web Conference 2026 (WWW '26 Companion), pp. 295-302
Related DOI: https://doi.org/10.1145/3774905.3795471

DOI(s) linking to related resources

Submission history

From: Alexander Loth [view email]
[v1] Thu, 29 Jan 2026 16:42:22 UTC (26 KB)
[v2] Wed, 11 Feb 2026 14:35:21 UTC (26 KB)
[v3] Thu, 29 Oct 2026 17:03:03 UTC (28 KB)

来源:arXiv cs.AI · arxiv.org