arXiv cs.AI· Shiran Liu, Gaohui Xu, Sergio Burdisso, Thibault Ba\~neras-Roux, Shashi Kumar, Petr Motlicek·· 3 天前AI 评分23
选择还是重写：面向生成式 ASR 后编辑的 Oracle 引导微调
Select or Rewrite: Oracle-Guided Fine-Tuning for Generative ASR Post-Editing from N-Best Hypotheses
AI 导读
研究者提出 oracle 引导微调方法，将 ASR 的 N-best 候选列表构建为三类监督数据——纠错池（正确答案在列表中但非 top-1）教模型选择、正则化池（top-1 已正确）抑制多余改写、困难负样本池（答案不在列表中）抑制幻觉，从而学习"选择或重写"的混合策略。
正文 · 原文
Abstract:Large language models can post-edit ASR by using linguistic context to compare N-best hypotheses and rewrite the transcript when needed, often improving WER without retraining the recognizer. However, prompt-only correction is brittle: it may over-edit when top-1 is correct and hallucinate when the reference is absent, and often needs very large models. We propose oracle-guided fine-tuning that turns N-best lists into supervision via three curated pools: corrections (reference in the list but not top-1) to teach selection, regularizers (top-1 correct) to discourage unnecessary rewrites, and hard negatives (reference absent) to suppress hallucination. Fine-tuning on this data provides more effective supervision than random subset fine-tuning for learning a hybrid select-or-rewrite policy, with the clearest gains from around 3B parameters on the proprietary dataset but less conclusive results on CommonVoice, a divergence suggesting that public read-speech text may overlap with LLM pretraining and mask genuine post-editing gains.
| Comments: | 7 pages, 4 figures, 2 tabl |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.15056 [cs.CL] |
| (or arXiv:2610.15056v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.15056 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Shiran Liu [view email]
[v1]
Sat, 10 Oct 2026 16:48:27 UTC (383 KB)
来源：arXiv cs.AI · arxiv.org