arXiv cs.CL· Divyanshu Bathla, Parag Singla, Jitin Singla·· 3 天前AI 评分31
回译依然有效：用单语数据提升 LLM 低资源机器翻译
Back-Translation Still Matters: Leveraging Monolingual Data for Low-Resource Machine Translation with LLMs
AI 导读
研究提出用回译（BT）而非继续预训练来利用低资源单语数据：微调后的 LLM 翻译单语句子生成反向平行对，并与平行集更新交替进行。在 Odia 和 Swahili 上仅用 1K 平行对，BT 在领域内比继续预训练高出 7.7 至 16.4 个 XCOMET-XXL 分，还优于平行数据多 10 倍的模型。
正文 · 原文
Abstract:Pre-trained Large Language Model (LLMs) are effective on many tasks in zero-shot and few-shot settings. For machine translation of low-resource languages, the obvious options are few-shot prompting and fine-tuning on a small parallel set. We ask: what if moderate amounts of low-resource monolingual data are also available? We argue that, rather than continued pretraining, a more effective use of this data is the pre-LLM era technique of back-translation (BT). The current fine-tuned LLM translates monolingual sentences in each language, and the resulting pairs train it in the reverse direction. Updates on the parallel set are interleaved for stable learning. With 1K parallel pairs on Odia and Swahili, BT beats continued pretraining into the low-resource language by 7.7 to 16.4 XCOMET-XXL points in domain. With beam-decoded intermediate translations, it also beats a model with 10 time more parallel data. In-context examples retrieved from the parallel data further improve BT. We also analyze the source, quality and amount of monolingual text. Across five low-resource languages, with Hindi as a high-resource control, and two 3B backbones, BT improves translation into the low-resource language by 16 to 173% XCOMET-XXL over parallel-only fine-tuning. Blind human evaluation on Odia and Sanskrit agrees with the automatic metrics.
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.18818 [cs.CL] |
| (or arXiv:2610.18818v2 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.18818 arXiv-issued DOI via DataCite |
Submission history
From: Jitin Singla [view email]
[v1]
Tue, 13 Oct 2026 17:50:18 UTC (706 KB)
[v2]
Wed, 14 Oct 2026 07:55:24 UTC (706 KB)
来源：arXiv cs.CL · arxiv.org