arXiv cs.CY· Zini Yang, Emily Wenger, Richard Jean So·· 12 小时前AI 评分38
模型趋同而人类发散：开放生成中分布多元性的覆盖框架
Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generation
AI 导读
研究提出以人类写作经验分布为基准的覆盖框架，用 LLM Coverage（LLM-Cov）和 In-Boundary Rate（IBR）两项指标衡量 LLM 生成内容的分布广度及其落在人类参考区域内的比例。
正文
Abstract:When a large language model (LLM) writes Harry Potter fanfiction, it can produce fundamental elements of the Hogwarts universe, such as recognizable places and characters. Human-written Harry Potter fanfiction, however, typically includes these fundamentals and much more, incorporating stylistically irregular content and relationship-diverse plotlines. This gap between LLM and human writing has been noted across a variety of domains. LLMs tend to produce "average" writing, while human writing contains more diverse content that covers a broader distribution. Existing work has shown the existence of this distributional "gap". We take a further step by providing a systematic framework to measure coverage of the human response distribution and identify which regions model samples reach or miss.
Our paper proposes a human-grounded framework that uses the empirical distribution of human writing on a topic to measure the distributional breadth of LLM-generated content on that same topic. We propose two metrics, LLM Coverage (LLM-Cov) and In-Boundary Rate (IBR), which measure both distributional breadth and membership in the human reference region, respectively. Across ideation and narrative tasks, we find that the tested LLMs have lower mean coverage than equally sized held-out human samples. We also find that model reach is disproportionately concentrated near the center of the human response space relative to this human benchmark. In Harry Potter fanfiction, covered and uncovered passages also show systematic differences in canon anchoring and narrative form. Our framework can enable researchers to better assess the distributional breadth--what we term the "cultural reach"--of LLM-authored content.
| Comments: | 21 pages, 3 figures |
| Subjects: | Computation and Language (cs.CL); Computers and Society (cs.CY) |
| Cite as: | arXiv:2608.05576 [cs.CL] |
| (or arXiv:2608.05576v2 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2608.05576 arXiv-issued DOI via DataCite |
Submission history
From: Zini Yang [view email]
[v1]
Thu, 6 Aug 2026 03:57:15 UTC (649 KB)
[v2]
Fri, 23 Oct 2026 23:19:05 UTC (819 KB)
来源：arXiv cs.CY · arxiv.org