跳到正文
RadarAI· X:Arena (@arena)·· 2 小时前AI 评分60

Arena 发布 Agent Arena Index 智能体评测指数及六个细分指数

Arena 发布 Agent Arena Index 智能体评测指数

AI 导读

Arena 发布 Agent Arena Index 及 Agentic Work、Coding、Chat、Task Outcomes、Tool Use、Steering 六个细分指数,基于社区数百万真实任务衡量智能体表现,并同步更新 Alignment Index。

正文 · 原文

Arena.ai· @arena · X·2026-11-19 02:50· 53 分钟前AI 评分54

AI 导读

Arena 发布 Agent Arena Index 及 Agentic Work、Coding、Chat、Task Outcomes、Tool Use、Steering 六个细分指数,基于社区数百万真实任务衡量智能体表现,并同步更新 Alignment Index。

正文 · 原文

Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work, Coding, Chat, Task Outcomes, Tool Use, and Steering.

Together with the Alignment Index, these indexes provide a comprehensive view of how agents perform across real-world tasks, from completing complex workflows to using tools and adapting to user feedback.

Arena measures agentic performance from millions of real-world tasks by our global community. With the launch of the new indexes, we are updating our scores to provide a more stable and interpretable way to understand how agents perform in the real world.

Claude Fable 5.2 (Max) leads the Agent Arena Index by 134 points with a score of 1463. Top 5 labs on the Agent Arena Index:

  • #1 @AnthropicAI: With Claude Fable 5.2 (Max) at 1463 pts
  • #2 @GoogleDeepMind: With Gemini 4 Carbon (High) at 1307 pts
  • #3 @OpenAI: With GPT-6 Astra (Max) at 1274 pts
  • #4 @AIatMeta: With Muse Wonder Full (Max) at 1200 pts
  • #5 @Alibaba_Qwen: With Qwen4-Max (xHigh) at 1191 pts

The Agent Arena Index combines four key signals of real-world agent performance:

  • Task Completion: explicit confirmation of task success from users
  • Praise vs. Complaint: user satisfaction with agent's outcome
  • Bash Reliability: how well an agent uses terminal tools
  • Steerability: how well an agent responds to user corrections

Alongside capability, the Alignment Index measures how faithfully agents act in accordance with user intent, based on three key signals: Deceptive Completion, Unauthorized Action, and False Attribution.

As agents take on increasingly complex, long-horizon work, measuring their real-world capabilities and alignment is more important than ever.

Explore the rankings and see what each index measures in the thread below.

引用Arena.ai@arena

x.com/i/article/2123122245950…

在 X 查看被引用的帖子

来源:Arena.ai · x.com

来源:RadarAI · aihot.news