跳到正文
Hacker News· paidev·· 6 天前AI 评分22

JevBench:面向类型化决策模型的开放基准,覆盖 Clef、pplx-decider 等 15 个以上模型

JevBench: Benchmarking decision models (Clef, pplx-decider and 15 more)

AI 导读

JevBench 是一个面向类型化决策模型的开放基准,提供论文 PDF、数据集与 GitHub 代码,覆盖 Clef、pplx-decider 等 15 个以上模型。榜单以 0 到 100 的均分展示每个模型在各数据集上的表现,并用条形区间标出最差到最好的模型,悬停单元格可查看区间与覆盖率,点击数据集名可生成图表。

正文 · 原文

Open benchmark for typed decision models.

Paper PDF Dataset GitHub Cite


Hover a cell for its interval and coverage. Click a dataset name to chart it.


Models

click a model for scores and where to get it


Average: mean score of every model on that dataset, 0 to 100. Bar: worst to best model. Scales differ, so compare datasets of the same metric most closely.


Submit


来源:Hacker News · leanmcp.github.io