跳到正文
arXiv cs.AI· Chamari Dasanayake, Rahul Mohanani, Vladimir Mandi\'c, Burak Turhan·· 10 小时前AI 评分19

生成式 AI 在软件测试中的应用:从业者对收益、挑战、机遇与风险的看法

Generative AI in Software Testing: Practitioners' Perspectives on the Benefits, Challenges, Opportunities, and Risks

AI 导读

一项针对 64 名从业者的问卷调查研究了生成式 AI 在软件测试中的收益、挑战、机遇与风险,其中 34 人为常规或实验性使用者、30 人未使用过。受访者普遍认为 GenAI 能减少工作量、辅助测试生成与调试,但也担忧提示词依赖、信任问题和错误输出。使用者更认可具体收益且更关注可靠性风险,非使用者对部分技术性挑战更不确定,研究将 GenAI 定位为需人工验证的辅助技术。

正文 · 原文

View PDF HTML (experimental)

Abstract:Generative Artificial Intelligence (GenAI) increasingly supports software testing, yet empirical evidence on practitioners' perceptions remains limited. This study investigates perceived benefits, challenges, opportunities, and risks of GenAI in software testing through a questionnaire survey of 64 practitioners. Closed-ended responses were analyzed descriptively, while open-ended responses were qualitatively coded to contextualize the findings. Among the respondents, 34 were users (those with regular or experimental use of GenAI in testing) and 30 were non-users (those without prior use of GenAI in testing). Results show generally positive perceptions of GenAI for reducing effort, test generation, and debugging, alongside concerns about prompt dependence, trust, and incorrect outputs. Users were more positive about several concrete benefits while also more frequently prioritizing reliability-related risks, whereas non-users showed greater uncertainty about some technically specific challenges. Overall, the findings position GenAI as an assistive technology requiring human validation and highlight the importance of considering practitioners' experience with GenAI when interpreting perceptions of GenAI-assisted testing.
Comments: Accepted for publication in 27th International Conference on Product-Focused Software Process Improvement (PROFES 2026)
Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI)
Cite as: arXiv:2611.23256 [cs.SE]
  (or arXiv:2611.23256v1 [cs.SE] for this version)
  https://doi.org/10.48550/arXiv.2611.23256

arXiv-issued DOI via DataCite

Submission history

From: Chamari Dasanayake [view email]
[v1] Sat, 26 Sep 2026 16:59:50 UTC (32 KB)

来源:arXiv cs.AI · arxiv.org