研究：通过 UI 轨迹指纹识别 LLM 浏览器智能体的底层模型

View PDF HTML (experimental)

Abstract:As LLM-based agents increasingly browse the web on users' behalf, a natural question arises: can websites passively identify which underlying model powers an agent? Doing so would represent a significant security risk, enabling targeted attacks tailored to known model vulnerabilities. Across 14 frontier LLMs and four web environments spanning information retrieval and shopping tasks, we show that an agent's actions and interaction timings, captured via a passive JavaScript tracker, are sufficient to identify the underlying model with up to 96\% F1 within a fixed harness. Although fingerprints are harness-specific, with cross-harness transfer falling to near chance, pooling traces across harnesses recovers model identification at 0.74 to 0.81 Macro-F1. We further show that strong classifiers can be trained from roughly one third of the available traces, and that identification improves steadily as more events are observed. Injecting randomised timing delays between actions substantially degrades classifier performance, but does not provide robust protection: a classifier retrained on delayed traces largely recovers performance. We release our code and a labelled corpus of agent traces at this https URL.

Comments:	Accepted at NeurIPS 2026
Subjects:	Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
Cite as:	arXiv:2605.14786 [cs.CR]
	(or arXiv:2605.14786v2 [cs.CR] for this version)
	https://doi.org/10.48550/arXiv.2605.14786 arXiv-issued DOI via DataCite

Submission history

From: William Gitta Lugoloobi [view email]
[v1] Thu, 14 May 2026 12:55:19 UTC (592 KB)
[v2] Tue, 10 Nov 2026 15:20:23 UTC (641 KB)