Kimi K3.1 Pro 以 55 分位列 Artificial Analysis Intelligence Index 第 4,Lambert 称超 Fable 5.1 与 Astra 6
Kimi K3.1 Pro 以 55 分登 Artificial Analysis Intelligence Index 第 4,Lambert 称超 Fable 5.1 与 Astra 6
Nathan Lambert 转引 Artificial Analysis 评测称,月之暗面 Kimi K3.1 Pro 以 55 分位列 Intelligence Index 第 4,高于 Fable 5.1 和 Astra 6,较 Kimi K3 提升 11 分。
Kimi K3.1 Pro 在智能体评测上的跃升与开源权重预期,为观察开源与闭源模型差距收窄提供了具体参照。
Nathan Lambert· @natolambert · X·2026-10-24 02:17· 26 分钟前同事件AI 评分81
AI 导读
Nathan Lambert 转引 Artificial Analysis 对月之暗面 Kimi K3.1 Pro 的评测:该推理模型以 55 分位列 Intelligence Index 第 4,高于 Fable 5.1 和 Astra 6,较 Kimi K3 提升 11 分。智能体性能大幅提升,GDPval-AA 得 1,846 Elo(升 312),Terminal-Bench 4.0 以 67% 超过 Claude Sonnet 5.5 的 64%;参数 2.8T(激活 104B)、上下文 1M token、价格较 K3 低 33%。权重尚未发布,预计很快开放,届时将成最高分开源权重模型,与闭源模型的差距从 12 分缩至 3 分。
同一件事,精选收录的是《Kimi K3.1 Pro 发布,以 55 分位列 Artificial Analysis Intelligence Index 第 4》
正文 · 原文
Higher score than Fable 5.1 and Astra 6, wild stuff.
Kimi K3.1 Pro launches at 4th on the Artificial Analysis Intelligence Index scoring 55, making large gains in agentic performance; it will be the leading open-weights model once its weights are published @Kimi_Moonshot's new reasoning model gains 11 points over Kimi K3 (max, 44). It trails only Claude Opus 5.5 (max with fallback, 58), Claude Sonnet 5.5 (max with fallback, 56), and Muse Wonder Full (max, 56) on the Intelligence Index. Once the weights for K3.1 Pro are released it will be the highest-scoring open weights model and the gap between the leading open weights and proprietary models on the Intelligence Index will narrow from 12 points to 3. Key results: ➤ Large gains in agentic performance: Kimi K3.1 Pro scores 3rd on GDPval-AA with 1,846 Elo, up 312 Elo from Kimi K3, behind only Claude Opus 5.5 (1,866 Elo) and Muse Wonder Full (1,857 Elo). Kimi K3.1 Pro also achieves the highest score of any model on Terminal-Bench 4.0. K3.1 Pro scores 67%, up from 13% for Kimi K3 and ahead of Claude Sonnet 5.5 (64%). AutomationBench-AA, which tests agentic SaaS workflows, rises from 58% to 73%. ➤ Gains in other evals are more moderate: Humanity's Last Exam rises from 47% to 52%, CritPt from 23% to 25%, and SciCode from 59% to 61%. AA-Omniscience Index rises from 20 to 30, as the hallucination rate falls from 53% to 44% and accuracy rises from 48% to 51%. ➤ Cost per Task roughly equal to Kimi K3 at $1.98 per Task: K3.1 Pro uses 55K output tokens per Intelligence Index task, 14% more than Kimi K3 at 48K, while its first-party token prices are 33% lower. Additional model details: ➤ Context window: 1M tokens. ➤ Size: 2.8T total, 104B active parameters ➤ Input modalities: Text and image ➤ Weights and license: Weights currently not published, Moonshot is expected to release the weights soon after launch ➤ Pricing: $2/$10/$0.20 per 1M input/output/cache hit tokens, 33% lower than Kimi K3 on all three rates. Congratulations to the team at @Kimi_Moonshot on the release!在 X 查看被引用的帖子
来源:Nathan Lambert · x.com
来源:RadarAI · aihot.news