arXiv cs.AI· Yasuhiro Fujiwara, Tatsuhiro Nakamori, Hideyuki Kawashima·· 1 天前AI 评分31
SPARC:用代表向量提升光子矩阵乘法推理精度
SPARC: Accurate Photonic Matrix Multiplication via Representative Vectors
AI 导读
SPARC 通过为每组相似激活向量构造一个代表向量、以数字方式高精度计算其内积,并把残差内积交给光子加速器,从而降低量化误差与模拟光子噪声的影响。该方法保留原有光子内积计算流程,无需修改硬件即可集成到现有及未来的光子加速器中。在六个代表性 DNN 模型上的实验显示,该方法可提升多种网络架构与应用领域的推理精度。
正文 · 原文
Abstract:Photonic neural network accelerators have emerged as a promising solution for reducing the power consumption of deep neural network (DNN) inference by executing matrix multiplication on analog photonic hardware. However, their inference accuracy is limited by low-bit quantization required for photonic processing and by analog photonic noise. This paper proposes an approach for improving inference accuracy by exploiting the high similarity among activation vectors in DNNs. Specifically, our approach constructs a representative vector for each group of similar activation vectors, computes its inner product digitally with high precision, and offloads the residual inner products to the photonic accelerator. Since the activation vectors within each group are highly similar, the residual vectors have much smaller norms, thereby reducing the effects of quantization errors and analog photonic noise. Furthermore, our approach preserves the photonic inner-product computation pipeline, allowing seamless integration into existing and future photonic accelerators without hardware modification. Experimental results on six representative DNN models demonstrate that the proposed approach can improve inference accuracy across diverse network architectures and application domains.
| Comments: | 11 pages, 5 figures, 3 tables |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.16561 [cs.AI] |
| (or arXiv:2611.16561v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.16561 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Hideyuki Kawashima [view email]
[v1]
Thu, 12 Nov 2026 09:47:42 UTC (1,881 KB)
来源:arXiv cs.AI · arxiv.org