arXiv cs.CL· Sezgin Saygili, Emre Kaplaner, Oncel Ozgul, Fikri San Koktas·· 10 小时前AI 评分31
Alania-2:支持即时与微调声音克隆的土耳其语 TTS 系统
Alania-2: Turkish text-to-speech with instant and fine-tuned voice cloning
AI 导读
Alania-2 是一个 488M 参数的土耳其语 TTS 系统,采用 VoxCPM 架构,在 18,195 小时土耳其语语音上从零训练,其中 90% 为更大教师模型生成的合成语音。
正文 · 原文
Abstract:We present Alania-2, a Turkish text-to-speech (TTS) system with two built-in voices, voice design from text descriptions, and two kinds of voice cloning. Alania-2 is a 488M-parameter model with the VoxCPM architecture, which generates continuous audio latents with a diffusion head on top of a language-model backbone. We train it from scratch on 18,195 hours of Turkish speech, 90% of which is synthetic speech produced by a larger teacher model and filtered automatically. A text normalizer rewrites numbers, abbreviations and foreign names into the words a Turkish speaker would say; without it, none of 96 test sentences with digits kept all its critical parts, such as an amount or a date, through synthesis and speech recognition, against 86 with it. On Freya-TR-Eval, a public benchmark of 495 Turkish sentences scored with automatic speech recognition, Alania-2 reaches a word error rate of 1.44%, compared with 5.99% for our previous system. On its built-in voices, it comes within half a point of character error rate of a 2.3B-parameter model at under a quarter of the size, and a 7.6M-parameter single-voice model trained with the same recipe matches the most intelligible systems we measured, which suggests that training data matters more for intelligibility than model size. We also report practical findings on voice cloning: conditioning on the reference audio alone, rather than continuing it, cuts skipped words from 21.9% to 1.7%; 20-30 seconds of reference audio works best; and a low-rank adapter trained in about two minutes raises speaker similarity well above instant cloning. Finally, we describe inference-engine changes that bring first audio down to 32 ms for a single stream. We release our evaluation harness and three Turkish speech and text datasets.
| Comments: | 21 pages, 11 figures, 10 tables. Evaluation harness and results: this https URL |
| Subjects: | Computation and Language (cs.CL); Sound (cs.SD) |
| Cite as: | arXiv:2611.13845 [cs.CL] |
| (or arXiv:2611.13845v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2611.13845 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Sezgin Saygili [view email]
[v1]
Tue, 10 Nov 2026 10:04:47 UTC (32 KB)
来源:arXiv cs.CL · arxiv.org