arXiv cs.AI· Ke Zhao, Zixiang Di, Hong Qian, Xiang Shu, Yaolin Wen, Qitao Shi, Bingdong Li, Xingyu Lu, Xiangfeng Wang, Jun Zhou, Ke Tang, Yang Yu·· 1 天前AI 评分31
MiniOpt：用有限资源推理建模并求解通用优化问题的轻量级 LLM
MiniOpt: Reasoning to Model and Solve General Optimization Problems with Limited Resources
AI 导读
MiniOpt 是一个通过“推理到建模再求解”范式和两阶段 RLVR 训练框架打造的轻量级优化专用 LLM，在八个优化基准上持续优于现有基于学习的优化模型，且参数量和训练数据大幅减少。团队还提出参数解耦评测协议，将优化结构理解与数值参数处理分离，结果显示 MiniOpt 在该设定下保持优化能力显著优于以往优化专用模型，表明其性能提升主要来自更强的优化结构理解。代码已公开。
正文 · 原文
Authors:Ke Zhao, Zixiang Di, Hong Qian, Xiang Shu, Yaolin Wen, Qitao Shi, Bingdong Li, Xingyu Lu, Xiangfeng Wang, Jun Zhou, Ke Tang, Yang Yu
Abstract:Achieving strong optimization generalization across diverse optimization problems while requiring limited training resources remains a challenging problem for optimization-oriented large language models (LLMs). Existing learning-based methods, however, typically require large-scale supervised data, expensive intermediate step verification, and extensive computational resources, while exhibiting limited optimization generalization across diverse optimization structures. In this paper, we propose \textsc{MiniOpt}, a lightweight optimization-specialized LLM trained through a reasoning-to-model-and-solve paradigm and a two-stage training framework with reinforcement learning with verifiable rewards (RLVR). MiniOpt encourages structure-oriented optimization learning by reinforcing the completeness of optimization formulations and optimization outcomes. Extensive experiments on eight optimization benchmarks demonstrate that MiniOpt consistently outperforms existing learning-based optimization models while requiring substantially fewer parameters and training data. To further understand optimization generalization, we introduce a complementary parameter-decoupled evaluation protocol that disentangles optimization structure understanding from numerical parameter processing. The results reveal that MiniOpt preserves optimization capability under parameter-decoupled settings significantly better than previous optimization-specialized models, suggesting that its performance gains primarily originate from stronger optimization structure understanding. These findings demonstrate an effective pathway toward efficient and generalizable optimization-specialized LLMs. The code is available at this https URL.
| Comments: | 36 pages, 9 figures, 11 tables, project: this https URL |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2606.25832 [cs.LG] |
| (or arXiv:2606.25832v3 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2606.25832 arXiv-issued DOI via DataCite |
Submission history
From: Ke Zhao [view email]
[v1]
Wed, 24 Jun 2026 13:48:06 UTC (530 KB)
[v2]
Thu, 25 Jun 2026 05:38:04 UTC (530 KB)
[v3]
Thu, 12 Nov 2026 14:32:46 UTC (843 KB)
来源：arXiv cs.AI · arxiv.org