arXiv cs.CL· Zubair Ajmal Farooq, Diptesh Kanojia·· 3 天前AI 评分22
在 Jetson Nano 上运行的质量感知自校正语音翻译系统
Quality-Aware Self-Correcting Speech Translation on an Edge Device
AI 导读
一套完全离线的语音到语音翻译流水线可在 Jetson Nano(4 GB)上运行,无需重训练即可自我纠正弱翻译:Whisper-tiny 做 ASR,Opus-MT 做翻译,多语言 BERT 余弦相似度作为质量估计(QE)门控,置信度低于阈值 τ 时触发二次翻译。
正文 · 原文
Abstract:We present a fully offline speech-to-speech translation pipeline that runs on a Jetson Nano (4 GB) and corrects its own weak translations without retraining. A Whisper-tiny ASR feeds an Opus-MT translator; multilingual BERT cosine similarity acts as a Quality Estimation (QE) gate, triggering a secondary-pass when confidence falls below a pre-defined threshold $\tau$. We compare three correction methods: QE reranking (M1), Minimum Bayes-Risk decoding (M2), and constrained beam search (M3). On 1,012 FLORES-200 sentences (English-Spanish), M2 at $\tau=0.90$ produces statistically significant improvements over greedy decoding on BLEU (+0.67, p<0.001), ChrF (+0.51, p<0.001), and COMET (+0.0020 at N=3, p=0.002); M1 yields no significant gains, and M3 is significantly worse than baseline (p>0.99). Our central finding is that QE functions effectively as a gate but poorly as a ranker: removing the QE model from candidate selection (M1$\to$M2) does not hurt quality and frees 680 MB from the critical path. Using a gain-to-edit ratio adapted from the post-editing-effort literature, we further show that smaller candidate pools (N=3) yield more surgical corrections with better semantic adequacy, while larger pools (N=10) maximise lexical reward. We release the system and demonstrate live translation across six language pairs.
| Comments: | v2: added code repository link; corrected figures, table labels and minor text. 7 pages, 2 figures, 4 tables. Full paper submitted to the Convergence 2026 proceedings; poster presented at Convergence 2026, University of Surrey. Code: this https URL |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.07545 [cs.CL] |
| (or arXiv:2610.07545v2 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.07545 arXiv-issued DOI via DataCite |
Submission history
From: Zubair Ajmal Farooq [view email]
[v1]
Tue, 6 Oct 2026 00:21:08 UTC (388 KB)
[v2]
Wed, 14 Oct 2026 08:03:16 UTC (134 KB)
来源:arXiv cs.CL · arxiv.org