arXiv cs.CL· Daniel Huang, Qi He, Shaoxiong Duan, Yingjie Li, Qiao Cheng, Yitao Duan·· 11 小时前AI 评分40
Confucius4-R2T2:面向真实实时转写的稳定前缀流式 ASR 模型
Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription
AI 导读
Confucius4-R2T2 是一个稳定前缀流式 ASR 模型,输出后不再修改已生成的 token,同时保持高准确率与低延迟。它在 1,500 小时中英文音频上对 Qwen3-ASR-1.7B 做后训练,冻结预训练音频编码器与投影层,基于新提出的 Longest Stable Prefix(LSP)概念实现,无需改动架构。
正文 · 原文
Abstract:Streaming speech recognition is increasingly consumed by machines, such as translators and voice agents, that act on each token as it appears. A token that is later revised costs wasted work or a wrong action. In this work, we present Confucius4-R2T2 (short for Real Real-Time Transcription), a stable-prefix streaming ASR model that never modifies its earlier output while maintaining high accuracy and low latency. R2T2 is obtained by post-training Qwen3-ASR-1.7B on 1,500 hours of Chinese and English audio while freezing its pre-trained audio encoder and projector. The adaptation is based on the concept of Longest Stable Prefix (LSP), a new notion that we introduce in this work. We prove that LSP is monotone under the prefix order, consistent with the full-audio output, and maximal among labels that equal a whole earlier output. Learning from LSP labels converts a full-context model into a stable-prefix streaming one without any architectural change. Extensive evaluations show that R2T2 brings streaming recognition close to the base model's full-context quality while delivering stable text with low emission lag. Its gains extend beyond the post-training languages, demonstrating a practical path from full-context ASR to stable streaming. We open-source the model weights and code at this https URL and this https URL.
| Comments: | 30 pages, 6 figures, 8 tables. Code and model weights available at this https URL and this https URL |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD) |
| Cite as: | arXiv:2611.06043 [cs.CL] |
| (or arXiv:2611.06043v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2611.06043 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Daniel Huang [view email]
[v1]
Wed, 4 Nov 2026 06:46:50 UTC (318 KB)
来源:arXiv cs.CL · arxiv.org