Arena 基于 20,869 条记录分析前沿编码模型与普通 Agent 的投诉差异

Arena.ai· @arena · X·2026-10-28 23:28· 12 分钟前AI 评分54

AI 导读

Arena 基于 20,869 条 Agent Arena: Code 记录，对比五个前沿模型（来自 Anthropic 与 OpenAI）与其他 Agent 的用户投诉分布。

正文 · 原文

Where do users actually feel the difference with a frontier coding agent?

Across 20,869 Agent Arena traces, we compared how users criticized the five top models (all from @AnthropicAI & @OpenAI) on Agent Arena: Code, versus how they criticized other agents.

Here are 3 areas where frontier models make the most difference:

1. Less getting stuck: Among sessions with complaints, failed repair loops come up 6.9 percentage points less often, and project context gets ignored less often too (-1.9 pp). You spend less time steering the agent out of dead ends.

2. Better taste and code that works: They are better at design (-6.4 pp) and at producing working results (-5.8 pp). What you get back is more likely to be what you wanted.

3. More diligence: They follow instructions better (-5.6 pp), finish the work more often (-4.9 pp) and break existing work less (-4.5 pp). There's less to clean up afterwards.

Curious for a deeper dive into Agent Arena's praise vs complaint signal? See the article below in thread.

来源：Arena.ai · x.com