跳到正文
arXiv cs.CL· Xiaoxue Ren, Penghao Jiang, Kaixin Li, Zhiyong Huang, Xiaoning Du, Jiaojiao Jiang, Zhenchang Xing, Jiamou Sun, Terry Yue Zhuo·· 2 天前AI 评分39

HackWorld:首个系统评估计算机使用智能体利用 Web 应用漏洞的框架

HackWorld: Evaluating Computer-Use Agents on Exploiting Web Application Vulnerabilities

AI 导读

HackWorld 是首个系统评估计算机使用智能体(CUA)通过视觉交互利用 Web 应用漏洞能力的框架,覆盖 11 个框架、7 种语言的 36 个真实应用,包含注入漏洞、认证绕过等真实缺陷。在 CTF 式测试中,当前最先进 CUA 的漏洞利用成功率低于 12%,且网络安全意识薄弱,常在多步攻击规划和工具使用上失败。

正文 · 原文

View PDF HTML (experimental)

Abstract:Web applications are prime targets for cyberattacks as gateways to critical services and sensitive data. Traditional penetration testing is costly and expertise-intensive, making it difficult to scale with the growing web ecosystem. While language model agents show promise in cybersecurity, modern web applications demand visual understanding, dynamic content handling, and multi-step interactions that only computer-use agents (CUAs) can perform. Yet, their ability to discover and exploit vulnerabilities through graphical interfaces remains largely unexplored. We present HackWorld, the first framework for systematically evaluating CUAs' capabilities to exploit web application vulnerabilities via visual interaction. Unlike sanitized benchmarks, HackWorld includes 36 real-world applications across 11 frameworks and 7 languages, featuring realistic flaws such as injection vulnerabilities, authentication bypasses, and unsafe input handling. Using a Capture-the-Flag (CTF) setup, it tests CUAs' capacity to identify and exploit these weaknesses while navigating complex web interfaces. Evaluation of state-of-the-art CUAs reveals concerning trends: exploitation rates below 12% and low cybersecurity awareness. CUAs often fail at multi-step attack planning and misuse security tools. These results expose the current limitations of CUAs in web security contexts and highlight opportunities for developing more security-aware agents capable of effective vulnerability detection and exploitation.
Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)
Cite as: arXiv:2510.12200 [cs.CR]
  (or arXiv:2510.12200v2 [cs.CR] for this version)
  https://doi.org/10.48550/arXiv.2510.12200

arXiv-issued DOI via DataCite

Submission history

From: Terry Yue Zhuo [view email]
[v1] Tue, 14 Oct 2025 06:52:15 UTC (1,827 KB)
[v2] Fri, 13 Nov 2026 12:08:42 UTC (1,827 KB)

来源:arXiv cs.CL · arxiv.org