跳到正文
arXiv cs.CL· S\'everin Baroudi, Yanis Labrak, Petr Motlicek, Herv\'e Bredin, Ricard Marxer·· 12 小时前AI 评分38

超越基准测试:Qwen3-TTS 的条件控制、领域表现与失败模式

Beyond the Benchmark: Conditioning, Domains and Failure Modes of Qwen3-TTS

AI 导读

研究系统评测了 Qwen3-TTS 的两种克隆接口 ICL 与 X-Vector,在朗读、会议、情感和空管语音上对比 Chatterbox、XTTS-v2 和 F5-TTS。

正文 · 原文

View PDF HTML (experimental)

Abstract:Qwen3-TTS reports state-of-the-art zero-shot voice cloning, but its technical report leaves open how the model should be conditioned, how it behaves outside read speech, and how it fails. We characterise its two cloning interfaces, in-context learning (ICL) and X-Vector, against Chatterbox, XTTS-v2 and F5-TTS on read, meeting, emotional and air-traffic-control (ATC) speech, using eighteen objective measures, an LLM judge, a spoofing countermeasure and a listening test. Neither interface dominates: ICL clones timbre more closely from correctly transcribed references, X-Vector clones timing, and ICL degrades sharply when a short reference transcript is wrong. Domain explains four times more variance than system choice. Qwen3-TTS leads on intelligibility and pitch register but trails on prosody, and the objective measures rank systems differently from listeners. An off-the-shelf countermeasure flags its clones no more often than genuine recordings, and on ATC radio it fails for every system. Code and audio are released.
Subjects: Sound (cs.SD); Computation and Language (cs.CL)
Cite as: arXiv:2610.23678 [cs.SD]
  (or arXiv:2610.23678v1 [cs.SD] for this version)
  https://doi.org/10.48550/arXiv.2610.23678

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Yanis Labrak [view email]
[v1] Fri, 16 Oct 2026 16:09:20 UTC (3,446 KB)

来源:arXiv cs.CL · arxiv.org