arXiv cs.CY· C\'esar Leblanc, Lukas Picek·· 9 小时前AI 评分32
作者如何看待 AI 辅助审稿:一项混合方法试点研究
Authors' Response to AI-Based Reviews: A Mixed-Methods Pilot Study
AI 导读
一项针对 LifeCLEF 2025、LifeCLEF 2026 和 CVWW 2026 三个计算机科学会议队列的混合方法试点研究显示,92 份问卷中 89%(82/92)的作者认为 AI 审稿意见有用,并采纳了至少部分建议用于修改论文。
正文 · 原文
Abstract:Background: Large language models are increasingly used to assist scholarly peer review, but there is limited evidence about how authors judge their feedback and use it to revise their papers.
Methods: We studied authors' experiences of receiving an auxiliary AI review alongside human reviews in three computer-science cohorts: LifeCLEF 2025, LifeCLEF 2026, and CVWW 2026. Post-review questionnaires yielded 92 responses concerning 71 papers. We summarized closed-ended answers using descriptive statistics and examined free-text responses through thematic analysis.
Results: Most responses rated the AI review useful (82/92 (89%), and 82/92 (89%) reported using at least some of its suggestions in revision. Authors reported that AI identified issues missed by human reviewers ((76/92 (83%). However, 44/92 (48%) trusted AI feedback less than human feedback, and 58/92 (63%) reported incorrect or misleading comments. Authors valued suggestions that improved clarity and reproducibility, but also described overlooked evidence, inappropriate demands, and difficulty finding useful comments within lengthy reviews. They emphasized the need to check AI feedback and retain control over how their manuscripts were processed. Future review by both humans and AI was supported by 85/92 (92%); 83/92 (90%) preferred advance notice and 73/92 (79%) supported explicit consent.
Conclusions: Authors often found AI reviews useful for revision without trusting them as much as human reviews. These exploratory findings favor a supplementary role for AI, with human oversight, clear disclosure, and author consent. They do not establish that AI can replace human reviewers or improve manuscript quality.
| Subjects: | Computers and Society (cs.CY); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2605.16623 [cs.CY] |
| (or arXiv:2605.16623v2 [cs.CY] for this version) | |
| https://doi.org/10.48550/arXiv.2605.16623 arXiv-issued DOI via DataCite |
Submission history
From: César Leblanc [view email]
[v1]
Fri, 15 May 2026 20:43:55 UTC (184 KB)
[v2]
Wed, 18 Nov 2026 20:23:40 UTC (529 KB)
来源:arXiv cs.CY · arxiv.org