arXiv cs.AI· Rishit Jain, Rishit Kar, Chetashri Bhadane, Nilesh Patil·· 12 小时前AI 评分27
冻结的预测基础模型做分类器:Reverso 与 Chronos-Bolt 在 MONSTER 基准上不及强基线
Big Models, Small Gains: Frozen Forecasters as Classifiers on MONSTER
AI 导读
研究在 MONSTER 基准的六个大型数据集上,用 1%、10%、100% 训练标签评测 Reverso 和 Chronos-Bolt 的冻结表征用于时间序列分类。预训练相比同架构随机权重版本在六个数据集中的五个上提升准确率,最高提升 23 个百分点,但冻结表征在 17 个设置中有 15 个不如最强的非预训练基线、2 个持平。恢复振幅信息可挽回部分差距,微调和预测误差特征则无法弥合。
正文 · 原文
Abstract:Forecasting foundation models are increasingly used as frozen feature extractors for time series classification, but it remains unclear whether their pretrained representations offer an advantage over strong classifiers that do not require pretraining. This raises an important question: do these representations provide useful information beyond what the model architecture alone can capture, particularly when labelled data are scarce? We present a controlled benchmarking of two forecasting models, Reverso and Chronos-Bolt, on six large datasets from the MONSTER benchmark, using 1%, 10%, and 100% of the available training labels. We compare their frozen representations against four established time series classification methods and random-weight versions of the same forecasting models. Our results show that pretraining improves classification accuracy over random-weight counterparts on five of the six datasets, with gains of up to 23 percentage points. However, the frozen representations do not reliably outperform the strongest non-pretrained baseline in any setting: they perform worse in 15 of 17 settings and tie in the remaining two. Further experiments show that restoring amplitude information recovers part of the performance gap, while fine-tuning and forecast-error features do not close it. These findings highlight the importance of strong task specific baselines and random weight controls when evaluating forecasting foundation models for classification. Our code is available at this https URL.
| Comments: | Asian Conference on Machine Learning, FMLTS Workshop, 2026 |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.06988 [cs.LG] |
| (or arXiv:2611.06988v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2611.06988 arXiv-issued DOI via DataCite |
Submission history
From: Rishit Kar [view email]
[v1]
Wed, 4 Nov 2026 16:50:28 UTC (56 KB)
来源:arXiv cs.AI · arxiv.org