跳到正文
arXiv cs.CL· Syed Rifat Raiyan, Md. Tariquzzaman, Md Farhan Ishmam, Tenghao Huang·· 2 天前AI 评分29

LLM 能否打乱顺序讲故事?非线性叙事生成语料库与基准发布

Can LLMs Tell Stories Out of Order? A Corpus and Benchmark for Nonlinear Narrative Generation

AI 导读

研究者发布包含 83 部已出版作品的基准,用于衡量语言模型能否讲述非线性故事,并为每部作品标注事件的时间顺序与叙述顺序,以及涵盖因果依赖、角色知识和悬念设置的故事图。

正文 · 原文

View PDF HTML (experimental)

Abstract:Every story has two orders: the order in which its events happen and the order in which they are told. A story is nonlinear when the two differ. We introduce a benchmark of 83 published works that measures whether language models can tell nonlinear stories. For each work, we annotate one list of events in both orders, together with a story graph of causal dependencies, character knowledge, and the questions the telling raises and resolves. Given events in chronological order, all 19 models tell them, on average, more chronologically than the published works do; asked for a specific structure, they land within the human range about half the time. We then compare a model's stories of the same events under different conditions, using both an automated judge and 71 human readers. Both prefer the chronological story a model writes by default to the nonlinear one it writes on request, which readers find harder to follow in 81% of decisive judgments. Readers also prefer stories written from the story graph to stories constrained to the published telling order (72% of decisive judgments), a difference the judge does not detect. Our results suggest that following an instruction to reorder a story is not yet the same as telling it well out of order.
Comments: Under review, 36 pages, 13 figures, 15 tables. Code and data: this https URL. Project page: this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.21468 [cs.CL]
  (or arXiv:2610.21468v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2610.21468

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Syed Rifat Raiyan [view email]
[v1] Thu, 15 Oct 2026 08:13:12 UTC (904 KB)

来源:arXiv cs.CL · arxiv.org