Artificial Analysis 更新 MLCR-AA 医疗长上下文推理榜单,Claude Sonnet 5.5 与 GPT-6 Astra 并列第一
Artificial Analysis 更新 MLCR-AA 医疗长上下文推理榜单
Artificial Analysis 更新了 Wisedocs 医疗长上下文推理基准 MLCR-AA 的提示与评分方式,Claude Sonnet 5.5(max with fallback)与 GPT-6 Astra(max)以 41.7% 并列第一,GPT-6.1 Sol(max)以 38.3% 紧随其后。
Artificial Analysis· @ArtificialAnlys · X·2026-10-21 23:53· 1 小时前AI 评分48
AI 导读
Artificial Analysis 更新了 Wisedocs 医疗长上下文推理基准 MLCR-AA 的提示与评分方式,Claude Sonnet 5.5(max with fallback)与 GPT-6 Astra(max)以 41.7% 并列第一。
正文 · 原文
We've updated MLCR-AA, our leaderboard for Wisedocs' Medical Long Context Reasoning benchmark, with Claude Sonnet 5.5 and GPT-6 Astra now tied for the #1 score
We've updated how MLCR-AA prompts and grades models on @wisedocsai's benchmark, to better reflect how medical record review is done in practice. Models are now prompted as medical record reviewers, and asked to answer each part of a question in one paragraph with their conclusion and the supporting evidence from the record. Answers are graded by a new three-model judge panel, and we reviewed all 60 expert reference answers against their source records, refining 15.
Claude Sonnet 5.5 (max with fallback) from @AnthropicAI and GPT-6 Astra (max) from @OpenAI are tied at the top with 41.7%, followed by GPT-6.1 Sol (max) at 38.3%. Qwen3.8 2.4T A95B from @Alibaba_Qwen is the leading open weights model at 30.6%.
Key results from the updated MLCR-AA:
➤ Medical record review remains far from solved: an answer passes only when it is both complete and accurate, and no model passes more than 42% of questions and the median model passes under 15%
➤ Anthropic models lead on completeness, reaching the expert's conclusion with the right medical reasoning: Claude models hold the top 18 completeness scores across every model and effort level we tested, led by Claude Sonnet 5.5 (max with fallback) at 64.8%. The best non-Anthropic model is GPT-6 Astra (max) at 42.2%
➤ OpenAI models lead on accuracy, citing the record without exaggeration or hallucination: OpenAI models hold the top 27 accuracy scores, led by GPT-6.1 Sol (max) at 96.7%, but answer fewer questions completely: GPT-6.1 Sol (max) is complete on 40.0% of questions
We would like to thank Wisedocs for building MLCR and for their collaboration in bringing it to Artificial Analysis
来源:Artificial Analysis · x.com
来源:RadarAI · aihot.news