arXiv cs.AI· Dongchan Cho, Jiho Han, Juwon Hwang, Changhee Min, Minsang Kim, Namsoon Jung·· 13 小时前AI 评分31
AnoMix:多教师评分原则蒸馏的无监督时间序列异常检测
Distilling Multi-Teacher Scoring Principles for Unsupervised Time Series Anomaly Detection
AI 导读
AnoMix 通过从冻结教师检测器的训练集异常分数中提取弱成对监督,并用多教师排序蒸馏目标 CoRank 将异构教师评分原则蒸馏进单个轻量学生检测器。在七个基准数据集上,该模型以不足 80k 参数的学生模型超越了单个检测器和静态分数集成。其零样本变体还显示蒸馏出的排序信号可迁移到未见数据集,并在异常检测上优于大型预训练时间序列基础模型。
正文 · 原文
Abstract:Time series anomalies take diverse forms, and individual detectors encode different anomaly scoring principles that rarely cover all anomaly types. Recent unsupervised time-series anomaly detectors provide complementary scoring signals, yet deploying them as an ensemble preserves the inference and maintenance cost of every individual detector. We study whether heterogeneous teacher detectors can be distilled into a single lightweight detector in the unsupervised setting, where no anomaly labels are available to define a shared target. AnoMix addresses this by extracting weak pairwise supervision from the training-set anomaly scores of frozen teachers. It normalizes each teacher score sequence independently and trains the student with CoRank, a multi-teacher ranking-distillation objective that converts teacher score gaps into pairwise supervision through teacher consensus. Across seven benchmark datasets, AnoMix successfully integrates complementary teacher scoring principles into a single deployable model, improving over individual detectors and static score ensembles while using a compact student with under 80k parameters on the benchmark settings. A zero-shot variant further shows that the distilled ranking signal transfers to unseen datasets and can outperform large pretrained time-series foundation models for anomaly detection.
| Comments: | Accepted by NeurIPS 2026 |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.29063 [cs.LG] |
| (or arXiv:2610.29063v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.29063 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Dongchan Cho [view email]
[v1]
Wed, 21 Oct 2026 01:42:19 UTC (544 KB)
来源:arXiv cs.AI · arxiv.org