arXiv cs.AI· Antonio Collante, Samuel Abedu, SayedHassan Khatoonabadi, Ahmad Abdellatif, Ebube Alor, Emad Shihab·· 1 天前AI 评分38
GPT 对代码审查流程的影响：GitHub PR 解决时间缩短超 60%
The Impact of Large Language Models (LLMs) on Code Review Process
AI 导读
一项基于 9,254 个 GitHub 项目、25,473 个 PR 的研究发现，GPT 辅助的 PR 中位解决时间为 9 小时，比非辅助 PR 的 23 小时缩短超 60%。其中审查时间减少 33%，等待接受时间减少 87%。在 300 个 GPT 辅助 PR 样本中，开发者主要用于代码优化（60%）、bug 修复（26%）和文档更新（12%）。
正文 · 原文
Abstract:Large language models (LLMs) have recently gained prominence in the field of software development, significantly boosting productivity and simplifying teamwork. Although prior studies have examined task-specific applications, the phase-specific effects of LLM assistance on the efficiency of code review processes remain underexplored. This research investigates the effect of GPT on GitHub pull request (PR) workflows, with a focus on reducing resolution time, optimizing phase-specific performance, and assisting developers. We curated a dataset of 25,473 PRs from 9,254 GitHub projects and identified GPT-assisted PRs using a semi-automated heuristic approach that combines keyword-based detection, regular expression filtering, and manual verification until achieving 95% labeling accuracy. We then applied statistical modeling, including multiple linear regression and Mann-Whitney U test, to evaluate differences between GPT-assisted and non-assisted PRs, both at the overall resolution level and across distinct review phases. Our research has revealed that early adoption of GPT can substantially boost the effectiveness of the PR process, leading to considerable time savings at various stages. Our findings suggest that GPT-assisted PRs reduced median resolution time by more than 60% (9 hours compared to 23 hours for non-assisted PRs). We discovered that utilizing GPT can reduce the review time by 33% and the waiting time before acceptance by 87%. Analyzing a sample dataset of 300 GPT-assisted PRs, we discovered that developers predominantly use GPT for code optimization (60%), bug fixing (26%), and documentation updates (12%). This research sheds light on the impact of the GPT model on the code review process, offering actionable insights for software teams seeking to enhance workflows and promote seamless collaboration.
| Subjects: | Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2508.11034 [cs.SE] |
| (or arXiv:2508.11034v2 [cs.SE] for this version) | |
| https://doi.org/10.48550/arXiv.2508.11034 arXiv-issued DOI via DataCite |
Submission history
From: Antonio Collante [view email]
[v1]
Thu, 14 Aug 2025 19:39:01 UTC (605 KB)
[v2]
Thu, 13 Nov 2025 13:33:44 UTC (540 KB)
来源：arXiv cs.AI · arxiv.org