跳到正文
arXiv cs.AI· Petr Senatorov, Karim Vafin, Elena Tutubalina, Oleg Somov·· 3 天前AI 评分40

Structural Chain-of-Thought:用可执行计算图进行推理

Structural Chain-of-Thought: Reasoning with Executable Computational Graphs

AI 导读

研究者提出 Structural Chain-of-Thought 框架,让大语言模型生成可执行计算图而非自由文本推理,最终答案由图确定性执行得出。模型通过基于图的强化学习训练,奖励结构有效性、答案正确性和与参考图的节点重叠。

正文 · 原文

View PDF HTML (experimental)

Abstract:Chain-of-thought prompting enables reasoning in large language models but produces explanations that are difficult to verify, expensive to generate, and not always faithful. We introduce a Structural Chain-of-Thought framework where models generate executable computational graphs instead of free-form reasoning. The final answer is obtained by deterministically executing the graph. The model is trained using graph-based reinforcement learning that rewards structural validity, answer correctness, and node overlap with reference graphs.
Experiments across five benchmarks and four model families show that our method consistently improves accuracy over supervised graph training and can reduce generation length by up to 5-6x compared with standard GRPO and chain-of-thought supervised training. Our faithfulness experiments reveal that models trained with our approach tend to rely on deriving their answers from the generated graphs rather than producing post-hoc rationalizations as usually in chain-of-thought reasoning.
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.15107 [cs.AI]
  (or arXiv:2610.15107v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.15107

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Peter Senatorov [view email]
[v1] Sat, 10 Oct 2026 18:29:30 UTC (3,070 KB)

来源:arXiv cs.AI · arxiv.org