Princeton 与 Google 论文提出 JevAgentHarness，用 4B 决策模型分担 LLM 智能体例行决策

Rohan Paul· @rohanpaul_ai · X·2026-10-19 17:04· 1 小时前AI 评分58

AI 导读

Princeton 与 Google 等机构的论文提出 JevAgentHarness，用小型决策模型回答智能体中的多选例行决策，仅在置信度低于阈值时交给 LLM。

正文 · 原文

New Princeton Univ + Google paper finds that the decision model most accurate on isolated questions solved only 69.5% of agent tasks, while a 4B model trained on agent states solved 91.5%.

Agent harnesses call a big LLM at every step, which makes long tasks slow and costly. Yet most of those calls just pick from a list, like which tool to use next.

Their harness asks a fast decision model each multiple-choice question and uses its answer only above a confidence threshold fitted on the agent's own runs. They also trained AgentDecision-4B on states the agent actually reaches, including after its own mistakes.

On tasks like their training data, 4B models trained this way made agents 81.1% to 89.0% cheaper and up to 2.5x faster. Success stayed within 3 points, while handing over every tool choice with no threshold lowered success by 19.0 points.

To hand routine agent choices to a small model, train it and set its confidence threshold on your agent's own runs.

– arxiv. org/abs/2610.21412

Title: "JevAgentHarness: Benchmarking, Deploying and Training Decision Models That Share Control with LLMs"

来源：Rohan Paul · x.com