arXiv cs.AI· Haichao Zhu, Geyang Xu, Zhaorui Yang, Jiyuan Wang, Qian Zhang·· 14 小时前AI 评分55
编码智能体在演进既有代码时更遵循先例还是任务意图
Precedent or Intent? What Coding Agents Follow When Evolving Existing Code
AI 导读
一项 arXiv 研究用双向受控实验考察编码智能体在既有代码与新任务指令冲突时如何取舍,覆盖 4 个编码智能体、6 组实现对共 5,625 次试验。
正文 · 原文
Abstract:Existing code reveals past implementation decisions but rarely explains the reasoning behind them. When coding agents implement new features or modify existing functionality, past decisions may conflict with new task instructions. This raises a fundamental question for agentic software evolution: when multiple implementations satisfy the same functional requirements, how do coding agents decide whether to follow existing code or new task instructions? We investigate this question through bidirectional, controlled experiments in purpose-built repositories, followed by validation in real-world open-source repositories. Our approach isolates three competing sources of guidance: (1) agents' default preferences, (2) repository precedents, and (3) explicit task instructions. We conduct 5,625 trials across four coding agents and six implementation pairs, with validation in four open-source repositories spanning three programming languages. We find that agents share the same default implementation choices, yet overwhelmingly follow repository precedent when it conflicts with those defaults (359/360 trials). Crucially, not all precedents carry equal influence: three supporting local files yield 96% adoption, compared with only 4% for sibling-resource files, and changing file placement alone can shift adoption from 0% to 100% at a fixed example count. When new task intent conflicts with existing code, written priority rules achieve substantially higher success than code examples alone (59/60 versus 38/60 joint successes for two agents on two implementation pairs). The effectiveness of explicit rules also extends to open-source repositories, where a harness-loaded rule raises joint success from 0/120 to 117/120. These findings motivate design-decision traceability that preserves not only implementation choices but also the rationale and priorities that should guide future changes.
| Comments: | 16 pages, 7 figures, 6 tables |
| Subjects: | Software Engineering (cs.SE); Artificial Intelligence (cs.AI) |
| ACM classes: | D.2.7; I.2.2 |
| Cite as: | arXiv:2610.38244 [cs.SE] |
| (or arXiv:2610.38244v1 [cs.SE] for this version) | |
| https://doi.org/10.48550/arXiv.2610.38244 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Geyang Xu [view email]
[v1]
Wed, 28 Oct 2026 03:50:17 UTC (53 KB)
来源:arXiv cs.AI · arxiv.org