arXiv cs.AI· Benjamin Hoover, Hugh Blayney, James C. R. Whittington·· 1 天前AI 评分34
经典能量模型 CRAM 推理速度比循环模型快 1,000 倍
Classical Energies Learn to Reason 1,000x Faster than Looped Models
AI 导读
研究者提出 CRAM——一种学习版的 Hopfield & Tank 80 年代能量模型,在单块 GPU 上训练 42 ms 和 132 ms 后分别解出 99.996% 的 Sudoku-Extreme 和 100% 的 Maze-Unique 测试题,比循环模型至少快 1,000 倍。
正文 · 原文
Abstract:Looped models have emerged as a prominent paradigm for reasoning, with successes on simple reasoning puzzles such as Sudoku-Extreme and Maze-Unique. However, these models can be unstable, slow to train, and use many parameters and FLOPs to solve simple puzzles. Descent on an energy not only mitigates these issues but also offers advantages: built-in early stopping, compute that adapts to problem difficulty, fast training without differentiating through a solver, and interpretable weights that learn the constraints of the puzzle. Here we demonstrate this with a learned version of Hopfield & Tank's energy from the 80s, which we term CRAM, solves 99.996% of Sudoku-Extreme and 100% of Maze-Unique test puzzles after 42 ms and 132 ms of training on one GPU, at least 1,000x faster than looped models on these tasks. CRAM also matches baseline looped models at their highest accuracy on Sudoku-Extreme using at least 282x fewer inference FLOPs. Our work suggests two things. First, that energies are an extremely promising direction for training reasoning from data. Second, a caution against using trivially solvable benchmarks like Sudoku and Maze to test the scalability of looped reasoning techniques.
| Subjects: | Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2611.17309 [cs.AI] |
| (or arXiv:2611.17309v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.17309 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Benjamin Hoover [view email]
[v1]
Thu, 12 Nov 2026 18:56:56 UTC (1,687 KB)
来源:arXiv cs.AI · arxiv.org