Arena 发布 Agent Arena Index 智能体评测指数及六个细分指数
Arena 发布 Agent Arena Index 智能体评测指数
Arena 发布 Agent Arena Index 及 Agentic Work、Coding、Chat、Task Outcomes、Tool Use、Steering 六个细分指数,基于社区数百万真实任务衡量智能体表现,并同步更新 Alignment Index。
Arena.ai· @arena · X·2026-11-19 02:50· 53 分钟前AI 评分54
AI 导读
Arena 发布 Agent Arena Index 及 Agentic Work、Coding、Chat、Task Outcomes、Tool Use、Steering 六个细分指数,基于社区数百万真实任务衡量智能体表现,并同步更新 Alignment Index。
正文 · 原文
Today, we’re excited to introduce the Agent Arena Index, our new headline measure of overall agent performance, alongside six new focused indexes: Agentic Work, Coding, Chat, Task Outcomes, Tool Use, and Steering.
Together with the Alignment Index, these indexes provide a comprehensive view of how agents perform across real-world tasks, from completing complex workflows to using tools and adapting to user feedback.
Arena measures agentic performance from millions of real-world tasks by our global community. With the launch of the new indexes, we are updating our scores to provide a more stable and interpretable way to understand how agents perform in the real world.
Claude Fable 5.2 (Max) leads the Agent Arena Index by 134 points with a score of 1463. Top 5 labs on the Agent Arena Index:
- #1 @AnthropicAI: With Claude Fable 5.2 (Max) at 1463 pts
- #2 @GoogleDeepMind: With Gemini 4 Carbon (High) at 1307 pts
- #3 @OpenAI: With GPT-6 Astra (Max) at 1274 pts
- #4 @AIatMeta: With Muse Wonder Full (Max) at 1200 pts
- #5 @Alibaba_Qwen: With Qwen4-Max (xHigh) at 1191 pts
The Agent Arena Index combines four key signals of real-world agent performance:
- Task Completion: explicit confirmation of task success from users
- Praise vs. Complaint: user satisfaction with agent's outcome
- Bash Reliability: how well an agent uses terminal tools
- Steerability: how well an agent responds to user corrections
Alongside capability, the Alignment Index measures how faithfully agents act in accordance with user intent, based on three key signals: Deceptive Completion, Unauthorized Action, and False Attribution.
As agents take on increasingly complex, long-horizon work, measuring their real-world capabilities and alignment is more important than ever.
Explore the rankings and see what each index measures in the thread below.
在 X 查看被引用的帖子
来源:Arena.ai · x.com
来源:RadarAI · aihot.news
