跳到正文
arXiv cs.AI· James Rhodes, George Kang·· 10 小时前AI 评分38

超越文档:面向任意工作产物的编译上下文与受治理智能体

Beyond the Document: Compiled Context and Governed Agents for Any Work Product

AI 导读

研究提出 Portable Agent Format(PAF)包,将工作产物与编译上下文、证据、来源及交互规则一同交付。在投资提案、基金研究、财报分析和工程事故复盘四个新包、400 道冻结问题与 12,000 条评估响应上,托管受治理阅读器整体成功率达 96%,而仅用指令加原始文件检索为 86%(Holm 校正 p < 10^-7);260 道可答题上为 94% 对 79%。

正文 · 原文

View PDF HTML (experimental)

Abstract:A document preserves the visible result of professional work but often discards the research, calculations, assumptions, evidence, and authorization boundaries behind it. We study a different unit of delivery: a Portable Agent Format (PAF) package that carries a work product together with compiled context, evidence, provenance, and rules for subsequent interaction. To test whether this context remains useful beyond the process that produced it, we evaluate four new packages, created after the hosted and offline readers were fixed: an investment proposal, fund research, financial-statement analysis, and an engineering incident review. Two packages were produced by specialized agents and two through a general-purpose assistant's packaging skill. Across 400 frozen questions and 12,000 evaluated responses, a hosted governed reader succeeds on 96% of questions versus 86% with instructions plus raw-file retrieval (Holm-adjusted p < 10^-7). On the 260 answerable questions per condition, success is 94% versus 79%; the gap varies by package. Source-material chat and instructions alone reach 48% and 74% overall. A separate 0.8-billion-parameter offline reader succeeds on 69% overall, but 54% on answerable questions. Its -1 response rate is 2.9%, combining materially wrong and unauthorized answers, versus 56% with the source and instructions alone. Ablations suggest advantages for the integrated selector and package-adapted writer, without isolating representation from training effects. The same run exposes a failure: offline retrieval resolves none of the 40 historical-record questions in one financial-data package. These findings support treating compiled knowledge as part of the delivered work product, while leaving independent standards interoperability and end-to-end governance conformance unproven.
Comments: 8 pages, 1 figure, 4-package held-out evaluation; 12,000 evaluated responses
Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
Cite as: arXiv:2611.13055 [cs.SE]
  (or arXiv:2611.13055v1 [cs.SE] for this version)
  https://doi.org/10.48550/arXiv.2611.13055

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: James Rhodes [view email]
[v1] Mon, 9 Nov 2026 15:20:00 UTC (18 KB)

来源:arXiv cs.AI · arxiv.org