跳到正文
arXiv cs.CL· Silviu Pitis, Parand A. Alamdari, Jessica Tang, Toryn Q. Klassen, Sheila A. McIlraith·· 23 小时前AI 评分38

VFM:面向智能体治理的多条自然语言准则运行时验证器

Runtime Verification of Multiple Natural Language Criteria for Agent Governance

AI 导读

研究者提出 VFM,一种树注意力验证器,可对 N 条自然语言准则并行打分并给出每条准则的独立三值判定。微调后的 VFM-4B 在合成治理基准上超过 GPT-5.4,在 DynaBench 多准则基准的轨迹级失败检测上超过 DynaGuard-4B。单张 H100 上,VFM-4B 对 4K token 上下文评估 1,000 条准则耗时不到 2 秒、显存占用低于 11 GB。

正文 · 原文

View PDF HTML (experimental)

Abstract:AI agents are governed by hundreds of natural language criteria, yet existing verifiers cannot efficiently evaluate an agent's output against a large set of such criteria and report which are satisfied, violated, or inapplicable. We introduce the VFM, a tree-attention verifier that encodes the shared context and target text, and scores N natural language criteria in parallel, returning independent per-criterion ternary verdicts. The VFM is pretrained on CriteriaBank, a corpus of 394K (context, target, criterion, verdict) tuples spanning over 321K distinct criterion strings. A finetuned VFM-4B outperforms GPT-5.4 on a synthetic governance benchmark. On the DynaBench multi-criterion benchmark, it outperforms DynaGuard-4B on trace-level failure detection, and its per-criterion verdicts localize the violated rule and support focused escalation to a larger chain-of-thought judge. We show that CriteriaBank pretraining improves cross-domain transfer, particularly in the low-data regime, while matching a strong direct-finetuning control at full data. On a single H100, VFM-4B evaluates 1,000 criteria against a 4K-token context in under 2s at <11 GB VRAM, making it suitable for runtime verification.
Comments: Accepted at NeurIPS 2026
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2611.23074 [cs.CL]
  (or arXiv:2611.23074v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2611.23074

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Silviu Pitis [view email]
[v1] Tue, 17 Nov 2026 17:01:00 UTC (1,989 KB)

来源:arXiv cs.CL · arxiv.org