arXiv cs.CL· Md Farhan Ishmam, Kenneth Marino·· 3 天前AI 评分32
TimeWarp：评估 Web 智能体在网页变迁下的表现
TimeWarp: Evaluating Web Agents by Revisiting the Past
AI 导读
研究者推出 TimeWarp 基准，用三个 Web 环境、每个含六种 UI 版本模拟网页演化，发现视觉型智能体易受界面变化影响，文本型智能体在单一版本微调后变得脆弱。为此提出基于计划蒸馏的标注方法 TimeTraj，用 BC-variant 训练后 Qwen-3 4B 从 20.4% 提升至 37.7%，Llama-3.1 8B 从 0% 提升至 27.0%。
正文 · 原文
Abstract:As web agents close the gap with humans on benchmarks, one question arises: Do today's agents perform just as well on tomorrow's web? We introduce TimeWarp, a benchmark that emulates the evolving web. TimeWarp consists of three web environments, each with six UI versions spanning UI design, frontend code, and workflows from different eras of the internet. We pair TimeWarp with a set of complex, realistic tasks covering different forms of web navigation. Our experiments reveal that vision-based agents are vulnerable to changes, while text-based agents become brittle once fine-tuned on a single version. To address this, we propose TimeTraj, a new annotation method that uses plan distillation to collect trajectories across multiple versions. By training agents on teacher rollouts using our BC-variant, we achieve substantial performance gains: 20.4% to 37.7% for Qwen-3 4B and 0% to 27.0% for Llama-3.1 8B models. Our work helps study generalization across web designs and opens a new paradigm for collecting plans rather than trajectories to improve the robustness of web agents.
| Comments: | NeurIPS 2026 Evaluations and Datasets |
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG) |
| Cite as: | arXiv:2603.04949 [cs.AI] |
| (or arXiv:2603.04949v4 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2603.04949 arXiv-issued DOI via DataCite |
Submission history
From: Md Farhan Ishmam [view email]
[v1]
Thu, 5 Mar 2026 08:43:06 UTC (11,625 KB)
[v2]
Tue, 8 Sep 2026 06:29:33 UTC (11,827 KB)
[v3]
Sat, 12 Sep 2026 06:26:13 UTC (11,829 KB)
[v4]
Wed, 14 Oct 2026 10:16:21 UTC (11,775 KB)
来源：arXiv cs.CL · arxiv.org