跳到正文
arXiv cs.AI· Zhengyang Zhang, Jing Xiong, Hongzhou Lin, Juihui Chung, Zijian Zhang, Song Han, Sihao Liu, Ligeng Zhu·· 6 天前AI 评分62

HOA:面向奥赛解题的多会话智能体工作流,在 IMO、IPhO、IOI 2026 取得满分

Humanize Olympiad Agents: A Multi-Session Workflow for Olympiad Problem Solving with Solve, Review, Wiki, Verify

AI 导读

研究者提出 HOA(Humanize Olympiads Agent),一个通过独立评审、结构化 wiki 和 Lean 证明验证三条反馈通道协调多个智能体会话的开放流程级框架。

正文 · 原文

View PDF HTML (experimental)

Abstract:Large language model (LLM) agents are rapidly improving on long-horizon scientific and olympiad tasks. Recent systems have produced a Lean-formalized resolution of the Navier--Stokes problem and autonomous solutions to four open questions in the Erdős Conjectures database. Yet neither system releases both its underlying model and complete inference stack. More broadly, a single agent session remains brittle on difficult problems: early errors can propagate, missing domain knowledge can stall progress, and apparent success can mask a misinterpretation or weakening of the original task. We introduce HOA (Humanize Olympiads Agent), an open, flow-level framework that coordinates multiple agent sessions through three complementary feedback channels. First, an independent reviewer evaluates each candidate and provides actionable feedback. Second, a structured wiki supplies task-specific knowledge that may be missing or unreliable in model pretraining. Third, a verifier checks generated Lean proofs against trusted challenge statements. With GPT-5.6 Sol, HOA achieves perfect scores on the IMO, IPhO, and IOI 2026, near-full marks on the IChO 2026 problem set, and solves all 672 problems (100%) on PutnamBench. On the Lean-Eval leaderboard, HOA ranks first, solving 251 of 304 problems (82.6%). We further evaluate HOA with open models. Using Kimi-K3, HOA achieves full scores on the IMO, IPhO, and IOI, and a gold-level score of 97.1% on the IChO. These results closely match the closed-source GPT-5.6 Sol + /Goal baseline on the IMO and IPhO, while exceeding it on the IChO and IOI, demonstrating that systematic feedback can help bridge substantial differences in base-model capability.
Subjects: Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.13632 [cs.AI]
  (or arXiv:2610.13632v1 [cs.AI] for this version)
  https://doi.org/10.48550/arXiv.2610.13632

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Zhengyang Zhang [view email]
[v1] Fri, 9 Oct 2026 14:14:14 UTC (2,505 KB)

来源:arXiv cs.AI · arxiv.org