arXiv cs.AI· Bowen Xu, Boyu Chen·· 9 天前AI 评分22
跨提供商审查作为编码智能体的运行时契约：一项受控试点与故障注入研究
Cross-Provider Review as a Runtime Contract for Coding Agents: A Controlled Pilot and Fault-Injection Study
AI 导读
研究提出一种跨提供商审查契约，让不同资源池的第二个智能体审查编码智能体的完成答案，并限定执行范围与审查者能力。在20组配对开发回合的受控试点中，8组出现实质性审查发现（95%精确区间19.1%-63.9%）。边界条件扫描复现了部分输入下的假成功：四个截断级别此前通过、修复后失败；CLI探测中Claude无写入工具，Codex在5次只读试验中均尝试写入但全部失败。
正文 · 原文
Abstract:Coding agents increasingly share a workstation while drawing on separate providers and subscription allowances. A second agent can inspect a completed answer, but the call spends another pool and may provide no substantive finding. We describe an advisory cross-provider review contract: distinct resource pools, bounded execution, restricted reviewer capabilities, complete input delivery, usable semantic output, explicit failure states and durable per-attempt evidence. In a controlled, agent-authored pilot of 20 paired development turns, eight had a material reviewer finding (95% exact interval 19.1-63.9%). A boundary-condition scan across both reviewer backends reproduced a previously discovered false success on partial input: four truncation levels passed historically and failed after repair. The scan also found and repaired cancellation during process reaping. In real CLI probes, Claude had no writing tools; Codex attempted writes in five of five read-only trials, each write tool failed, and no disposable repository changed. These tests cover specified paths and versions, not field reliability. A preregistered shadow study of metadata-only review allocation accrued 25 formal observations before an exact-runtime regression found a third defect: a reviewer exiting nonzero with a well-formed verdict was counted as complete. Exit status was not recorded per attempt, so exposure cannot be resolved retrospectively. The 25 formal and two pending records remain an audit cohort; the measurement-valid cohort restarted at zero and collection has begun. No gate result is reported.
| Comments: | 11 pages, 1 figure, 3 tables. Project page: this https URL |
| Subjects: | Software Engineering (cs.SE); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.10961 [cs.SE] |
| (or arXiv:2610.10961v1 [cs.SE] for this version) | |
| https://doi.org/10.48550/arXiv.2610.10961 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Bowen Xu [view email]
[v1]
Wed, 7 Oct 2026 22:28:22 UTC (52 KB)
来源：arXiv cs.AI · arxiv.org