arXiv cs.AI· Adarsh Arigala, Arjun Gangwar, Srinivasan Umesh·· 3 天前AI 评分22
面向印度语言的跨语言 TTS:基准与推理时时长估计策略
Cross-Lingual TTS for Indian Languages: A Benchmark and Inference-Time Duration Estimation Strategies
AI 导读
研究者构建了覆盖英语和九种印度语言的跨语言 TTS 评测基准,并提出一种语言感知的推理时时长估计策略,无需重训练或改动架构即可将语言特定的每字符时长统计引入无对齐 TTS。在双语和多语 A-DMA 模型上的实验显示,语音自然度、可懂度和说话人相似度均有提升,同时时长失配减少。数据集与代码配方已公开。
正文 · 原文
Abstract:Recent alignment-free Text-to-Speech (TTS) models achieve high synthesis quality by removing explicit alignment modules and simplifying training. However, they often struggle in cross-lingual scenarios due to differences in character durations across languages, leading to duration mismatch and degraded speech quality. Existing approaches typically address this issue using explicit duration predictors, increasing model complexity. Systematic evaluation of TTS performance for Indian languages in cross-lingual settings remains under-explored due to the lack of standardized evaluation benchmarks. In this work, we construct a cross-lingual evaluation benchmark covering English and nine Indian languages and propose a language-aware inference-time duration estimation strategy for alignment-free TTS that incorporates language-specific duration-per character statistics without retraining or architectural modifications. We further develop heuristic formulations that refine duration estimation based on language-dependent duration variations. Experiments on bilingual and multilingual A-DMA models demonstrate improved speech naturalness, intelligibility, and speaker similarity while reducing duration mismatch.
| Comments: | 9 pages, 3 figures, 5 tables. Accepted at the AACL-IJCNLP 2026 Workshop Multi-LLL. The dataset and code recipes are available at: this https URL |
| Subjects: | Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD) |
| Cite as: | arXiv:2610.14826 [eess.AS] |
| (or arXiv:2610.14826v1 [eess.AS] for this version) | |
| https://doi.org/10.48550/arXiv.2610.14826 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Adarsh Arigala [view email]
[v1]
Sat, 10 Oct 2026 11:41:56 UTC (77 KB)
来源:arXiv cs.AI · arxiv.org