arXiv cs.AI· Bingnan Xiao, Chenhao Yang, Bingcong Li, Wei Ni, Xin Wang·· 10 天前AI 评分22
面向 LLM 推理的自适应 Power Sampling（APS）
Adaptive Power Sampling for LLM Reasoning
AI 导读
研究者提出 Adaptive Power Sampling（APS），一种无需训练的推理采样方法，按每条查询动态调整锐化指数，依据答案一致性与模型自奖励的关系在测试时逐查询设定。在 MATH500、HumanEval、GPQA 等推理任务上，APS 一致优于固定锐化指数的 power sampling，且无需额外训练。
正文 · 原文
Abstract:Sequence-level power sampling has recently emerged as a training-free approach to reasoning by sampling from a sharpened output distribution of a base large language model (LLM). Nevertheless, existing methods typically sharpen the base model distribution uniformly across queries, overlooking variations in query difficulty and in how well the base model already handles each query. The goal of this work is to equip power sampling with query adaptivity. Theoretically, we show that the benefits of further sharpening are determined by the self-reward gap between correct and incorrect responses. Based on this insight, we propose \emph{Adaptive Power Sampling} (APS), which adjusts the sharpening exponent on a per-query basis at test time using the relationship between answer agreement and the model's self-reward. Experiments across diverse reasoning tasks, including MATH500, HumanEval, and GPQA, show that APS consistently outperforms power sampling with a fixed sharpening exponent, without additional training.
| Comments: | 22 pages, 6 figures |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.08563 [cs.AI] |
| (or arXiv:2610.08563v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.08563 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Bingnan Xiao [view email]
[v1]
Tue, 6 Oct 2026 15:43:35 UTC (279 KB)
来源：arXiv cs.AI · arxiv.org