arXiv cs.AI· Yi Ding, Li Shang·· 14 小时前AI 评分31
Formulaic：用语言模型智能体做 AI 基础设施的软硬件协同设计
Learning to Formulate: Agentic Hardware-Software Co-Design of AI Infrastructure through Progressive Optimization and Verification
AI 导读
Formulaic 将 AI 基础设施设计拆分为三步：智能体编写数学形式化问题，求解器在其内优化，验证与测量检查假设和结果。在 NVIDIA GB10 上，智能体编写的模板运行完整 Qwen3-8B 层比 SGLang 快 1.075 倍；模拟 Ventus GPU 研究中，联合设计将 Qwen2.5-0.5B 最差场景周期降至参考的 0.428，纯软件方案为 0.934。
正文 · 原文
Abstract:AI infrastructure, the chips and software that train and serve AI models, is designed in layers. Layers make the system manageable, but they also fix which choices an optimizer can consider. Gains that need the chip and its software to change together are excluded before optimization begins: the formulation leaves them out. Language-model agents make it possible to revisit these boundaries, but an agent's proposal cannot show by itself that a design is correct or optimal. We present Formulaic, a flow that divides the work. The agent writes the formulation, a mathematical solver optimizes within it, and verification and measurement check its assumptions and results. The agent refines the problem step by step, from the computation graph toward the chip. Each step is a template: a family of programs with the conditions under which they are correct. Wall relaxation searches the chip by pricing the hardware limits that bind the software. This paper takes a first step, through separate studies rather than one end-to-end run. On NVIDIA GB10, templates the agent wrote run complete Qwen3-8B layers $1.075\times$ faster than SGLang. In a simulated Ventus GPU study, joint design cuts the worst-scenario cycles of Qwen2.5-0.5B to 0.428 of the reference, against 0.934 for software alone. On a five-step GEMM refinement chain, reusing proofs makes checking $2.51\times$ faster.
| Subjects: | Hardware Architecture (cs.AR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC) |
| Cite as: | arXiv:2610.39380 [cs.AR] |
| (or arXiv:2610.39380v1 [cs.AR] for this version) | |
| https://doi.org/10.48550/arXiv.2610.39380 arXiv-issued DOI via DataCite |
Submission history
From: Yi Ding [view email]
[v1]
Thu, 29 Oct 2026 05:15:00 UTC (383 KB)
来源：arXiv cs.AI · arxiv.org