arXiv cs.AI· Birmjune Kim, Hyungju Lee, Hyun Oh Song·· 14 小时前AI 评分20
时间序列基础模型的动态多步解码策略
Dynamic Multi-Step Decoding for Time-Series Foundation Models
AI 导读
研究者提出一种动态策略选择器,为冻结的预训练时间序列基础模型在推理时自适应选择预测展开调度,而非固定使用一次性预测或自回归解码。在 fev-bench 上,冻结的 Chronos-2 主干配合一致性门控选择,在较长预测跨度上显著提升点预测 MASE,并回收约 6-8% 的真值选择动态规划增益;冻结的 Moirai-1.1-R-small 主干在全基准上同样显著。
正文 · 原文
Abstract:Time-series forecasting models typically use a fixed decoding strategy at inference time: either one-shot prediction of the full horizon or autoregressive rollout over atomic chunks. While one-shot decoding reduces error accumulation, it can discard useful sequential structure; conversely, autoregressive decoding preserves temporal dependencies but may compound errors. We argue that the optimal decoding strategy is not fixed across inputs, but should be selected adaptively for each forecasting instance. We propose a dynamic strategy selector that treats the forecast rollout schedule as an inference-time decision problem for frozen pretrained time-series foundation models. The selector is a learned network that ranks candidate rollout schedules using hidden states of the backbone, and is trained on historical windows of the evaluated tasks for each backbone. To make the candidate set tractable over the exponentially large space of horizon partitions, we use dynamic programming that reduces candidate evaluation to quadratic complexity while preserving much of the oracle gain. At deployment, five independently trained selectors vote on each decision, and the policy follows their consensus, falling back to the backbone's one-shot forecast where they disagree. The construction requires only the backbone's hidden states and lightweight selectors, with no fine-tuning of the forecasting backbone. On fev-bench with a frozen Chronos-2 backbone, agreement-gated selection improves point-forecast skill (MASE) over one-shot decoding with statistical significance, mostly on longer horizons. It recovers about 6-8% of the gain that the same dynamic program attains with ground-truth selection. With a frozen Moirai-1.1-R-small backbone, the improvement is also significant on the full benchmark, and for both backbones we claim gains in point accuracy only.
| Comments: | 23 pages including appendix, 2 figures, 20 tables |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.34409 [cs.LG] |
| (or arXiv:2610.34409v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.34409 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Birmjune Kim [view email]
[v1]
Sun, 25 Oct 2026 16:10:01 UTC (167 KB)
来源:arXiv cs.AI · arxiv.org