arXiv cs.AI· Kai Sun, Peibo Duan, Zhanglu Yan, Guowei Zhang, Yongsheng Huang, Levin Kuhlmann·· 12 小时前AI 评分22
SpikeQ:面向脉冲神经网络的脉冲引导训练后量化框架
SpikeQ: Spike-Guided Post-Training Quantization for Spiking Neural Networks
AI 导读
SpikeQ 是一个脉冲引导的训练后量化(PTQ)框架,用于脉冲神经网络(SNN)。研究发现相同 MSE 的量化误差造成的精度损失差异很大,而翻转相同比例脉冲的误差损失一致,因此按下游神经元脉冲误差选择权重量化级别,并针对芯片在发放前比较阈值的特性构建 reset-aware 网格,使阈值落在舍入边界上。
正文 · 原文
Abstract:On neuromorphic chips, spiking neural networks (SNNs) consume far less energy than artificial neural networks (ANNs), but the limited memory of these chips requires low-bit synaptic weights and membrane potentials. Existing post-training quantization (PTQ) methods provide them without retraining and, like those for ANNs, minimize numerical errors such as the mean squared error (MSE). In an SNN, however, a quantization error reaches later layers only through the spikes it flips. We find that errors of equal MSE can cause very different accuracy losses, whereas errors that flip the same fraction of spikes cause the same loss. We therefore propose SpikeQ, a spike-guided PTQ framework. For weights, we select the level of each weight by simulating the downstream neurons and minimizing their spike errors. For membrane potentials, most existing methods quantize the state after the reset, whereas neuromorphic chips compare the threshold with the membrane potential stored at a fixed bit width. We target this pre-fire quantization and build a reset-aware grid that places the threshold on a rounding boundary, so rounding never flips the spike at the current time step. We evaluate SpikeQ on seven benchmarks of image classification, semantic segmentation, and object detection. With 2-bit pre-fire membrane potentials, every existing grid collapses, whereas SpikeQ retains most of the full-precision accuracy. With both at 4 bits, the models stay within 2.59 points of full precision, shrink their memory footprint 7.8--7.9 times, and use 6.4--6.9 times less energy.
| Subjects: | Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV) |
| Cite as: | arXiv:2610.23046 [cs.NE] |
| (or arXiv:2610.23046v1 [cs.NE] for this version) | |
| https://doi.org/10.48550/arXiv.2610.23046 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Kai Sun [view email]
[v1]
Fri, 16 Oct 2026 07:24:52 UTC (3,653 KB)
来源:arXiv cs.AI · arxiv.org