arXiv cs.CY· Adam Visokay, Soumyakanti Pan, Molly Griston, Polina Iasakova, Mark Nepf, Denis Peskoff, Riya Sinha, Jikai Sun, Isabelle Thiara, Letao Wang, Yiwei Wu, Lauren Yan, Tyler H. McCormick·· 11 小时前AI 评分58
AI 生成网页内容的不均衡增长
The uneven rise of AI-generated web content
AI 导读
一项基于超过 500 万个可抓取网页的研究显示,含 AI 生成文本的网页占比快速上升,但分布并不均衡。英文网页中含 AI 生成文本的比例高于其他语言,.gov 和 .edu 域名的比例明显低于 .com,这些差异在控制构成效应后依然存在。
正文 · 原文
Authors:Adam Visokay, Soumyakanti Pan, Molly Griston, Polina Iasakova, Mark Nepf, Denis Peskoff, Riya Sinha, Jikai Sun, Isabelle Thiara, Letao Wang, Yiwei Wu, Lauren Yan, Tyler H. McCormick
Abstract:In less than five years, generative artificial intelligence (AI) has dramatically reshaped the public-facing web. Using a sample of more than 5 million crawlable webpages, we demonstrate that the share containing AI-generated text has increased precipitously, but unevenly. Our analyses reveal substantial differences in AI composition across language and domain categories (e.g., .edu, .com, or .gov). A higher fraction of English-language webpages contain AI-generated text compared to pages in other languages, and prevalence is substantially lower on .gov and .edu domains compared to .com. These distinctions persist even after accounting for compositional effects. We also find heterogeneity based on a page's position in the connectivity structure of the web. AI-generated text is most common and has increased most rapidly in pages that are the least central in the graph, which drives much of the overall growth in AI-generated text. A slower increase has taken place for more central pages, with the most central tier emerging as the least likely to contain AI-generated text. Methodologically, we use multiple AI detection tools, and generate estimates using a Bayesian hierarchical model that incorporates corrections for the detectors' statistical properties (both false positives and false negatives) and allows for different detector performance across groups, while propagating uncertainty in detector error rates into prevalence estimates. Our work suggests that AI is a prominent, but varied, contributor to public information and internet-based communication.
| Comments: | 12 pages, 4 figures |
| Subjects: | Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Networking and Internet Architecture (cs.NI); Applications (stat.AP) |
| Cite as: | arXiv:2610.36631 [cs.AI] |
| (or arXiv:2610.36631v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.36631 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Adam Visokay [view email]
[v1]
Tue, 27 Oct 2026 04:33:49 UTC (989 KB)
来源:arXiv cs.CY · arxiv.org