Multi-SFT：可商用许可的多语言指令跟随数据集

Multi-SFT: Permissively-Licensed Multilingual Instruction-Following

AI 导读

Multi-SFT 是一个可商用许可的多语言指令跟随数据集，包含五种欧洲语言的 502,818 条指令-响应对，通过翻译与重新生成流程构建。研究团队微调了 EuroLLM、OLMo 2、Qwen3 三个家族共九款模型（1B-32B），在 13 个基准上评测，结果显示 Multi-SFT 单独使用即可媲美更大的增强混合数据集和官方指令微调版本，在安全任务上优势尤为明显。

正文 · 原文

View PDF HTML (experimental)

Abstract:Supervised fine-tuning datasets remain overwhelmingly English-centric and commercially restricted, as their content is frequently generated by proprietary models whose terms of service forbid training competing systems. We introduce Multi-SFT, a commercially permissive collection of 502,818 instruction-response pairs across five European languages, built via translation and regeneration pipelines for tasks where translation is insufficient. Human evaluation yields inter-annotator agreement of at least 0.87 across all datasets and languages. Fine-tuning nine models from three different families (EuroLLM, OLMo 2, Qwen3; 1B-32B) and evaluating them on 13 benchmarks shows that Multi-SFT alone is competitive with larger augmented mixes and official instruction-tuned releases, with decisive advantages on safety tasks.

Comments:	13 pages, 7 tables
Subjects:	Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:	arXiv:2610.22086 [cs.CL]
	(or arXiv:2610.22086v1 [cs.CL] for this version)
	https://doi.org/10.48550/arXiv.2610.22086 arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Kamyar Zeinalipour [view email]
[v1] Thu, 15 Oct 2026 15:39:41 UTC (30 KB)

来源：arXiv cs.CL · arxiv.org