跳到正文
arXiv cs.AI· Hansheng Ren·· 13 小时前AI 评分20

Halo 架构:用有理算术实现无限深度推理,从模糊浮点到精确计算

From Fuzzy to Exact: The Halo Architecture for Infinite-Depth Reasoning via Rational Arithmetic

AI 导读

研究者提出 Halo 架构,基于有理数域(Q)并配备定制 Exact Inference Unit(EIU),用精确算术替代 LLM 依赖的浮点运算。该架构通过 Dual-Ring Topology 解决有理算术位宽指数增长问题:Micro-Ring 用 Diophantine Approximation 约束内存复杂度,Macro-Ring 通过周期性状态坍缩保证逻辑一致性。

正文 · 原文

View PDF HTML (experimental)

Abstract:The prevailing scaling paradigm of Large Language Models (LLMs) rests on a substrate of "Fuzzy" floating-point arithmetic. To mitigate the inherent instability of this approximate foundation, modern architectures have erected a complex scaffolding of structural and numerical heuristics--Complex Residuals, Pre-RMSNorm, Attention Scaling, and Gradient Clipping--consuming significant compute solely to prevent numerical collapse.
We propose a paradigm shift to the "Exact". We introduce the Halo Architecture, grounded in the Rational Field (Q) and powered by a custom Exact Inference Unit (EIU). To resolve the exponential bit-width growth of rational arithmetic, Halo employs a Dual-Ring Topology that unifies two complementary control mechanisms: (1) The Micro-Ring (Continuum Maintenance), which strictly bounds memory complexity via Diophantine Approximation; and (2) The Macro-Ring (Symbolic Alignment), which enforces logical consistency via periodic state collapse.
This stable dual-ring substrate allows for the "Great Dismantling" of numerical scaffolding, reducing the Transformer block to its "Clean" algebraic form (Tabula Rasa). Furthermore, we verify the "Efficiency Paradox": the elimination of gradient noise (sigma -> 0) allows for Macro-Learning Rates, potentially reducing the Total Time-to-Convergence by orders of magnitude. Halo demonstrates that General Intelligence requires the hybridization of continuous fields and discrete chains under a rigorous mathematical framework.
Comments: Revised in response to feedback received during the Conference on Next Generation Arithmetic (CoNGA) review process. Added formal analysis of precision-escalation termination and Diophantine approximation error bounds; expanded related work
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Hardware Architecture (cs.AR)
Cite as: arXiv:2601.18702 [cs.LG]
  (or arXiv:2601.18702v5 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2601.18702

arXiv-issued DOI via DataCite

Submission history

From: Hansheng Ren [view email]
[v1] Mon, 26 Jan 2026 17:24:34 UTC (974 KB)
[v2] Sun, 1 Feb 2026 07:13:30 UTC (989 KB)
[v3] Sat, 7 Feb 2026 17:53:30 UTC (995 KB)
[v4] Mon, 16 Feb 2026 07:24:47 UTC (1,107 KB)
[v5] Tue, 20 Oct 2026 19:26:19 UTC (1,123 KB)

来源:arXiv cs.AI · arxiv.org