arXiv cs.AI· Aruna Mohan, Burcu Ozek, Or Zilbershot, Fatemeh Afghah·· 13 小时前AI 评分30
QECGBERT：基于 VQ-VAE 波形分词与自监督语言学习的可扩展 ECG 基础模型
QECGBERT: A Scalable ECG Foundation Model Based on Self-Supervised Language Learning via VQ-VAE Waveform Tokenization
AI 导读
QECGBERT 是一个自监督 ECG 语言模型，通过 VQ-VAE 对 12 导联 ECG 的 P、QRS、T 波与等电位背景波形进行分词，并用连续波形特征补充量化中丢失的形态信息，从而以短序列完成 BERT 掩码语言建模。
正文 · 原文
Abstract:AI foundation models play a pivotal role in advancing heart disease diagnosis from electrocardiogram (ECG) data, particularly for rare diseases where the lack of sufficient labeled data hinders supervised learning. However, most self-supervised learning methods treat ECGs as generic sequence or image data without exploiting underlying physiological structure. To address this limitation, we propose QECGBERT, a self-supervised ECG language model that explicitly encodes physiological semantics by tokenizing the P, QRS, T, and isoelectric background waveforms. Vector-quantized variational autoencoder (VQ-VAE) tokenization is applied to each 12-lead ECG, with tokens enriched by continuous waveform features to preserve morphology lost during quantization without increasing sequence length. This design enables compact BERT masked language modeling with short sequences, improving scalability and reducing computational cost relative to long-sequence approaches. QECGBERT applies BERT pre-training to the MIMIC-IV dataset containing over 800,000 unlabeled ECG recordings, and fine-tuning on labeled PTB-XL, CPSC2018, and Chapman--Shaoxing--Ningbo datasets for evaluation. The results demonstrate that QECGBERT achieves comparable or superior performance to published benchmarks, offering a scalable, physiologically aware approach to ECG foundation modeling for cardiac diagnosis.
| Comments: | This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Submitted to IEEE ICASSP 2027 |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.33964 [cs.LG] |
| (or arXiv:2610.33964v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.33964 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Aruna Mohan [view email]
[v1]
Sun, 25 Oct 2026 00:37:53 UTC (849 KB)
来源：arXiv cs.AI · arxiv.org