arXiv:cs.AI· Adarsh Arigala, Arjun Gangwar, Srinivasan Umesh·· 23 小时前
面向印度语言的跨语言 TTS:A-DMA 基准与推理时时长估计策略
Cross-Lingual TTS for Indian Languages: A Benchmark and Inference-Time Duration Estimation Strategies
AI 导读
针对无对齐 TTS 模型在跨语言场景中因字符时长差异导致的时长失配问题,研究者构建了覆盖英语和九种印度语言的跨语言评测基准,并提出一种语言感知的推理时时长估计策略,无需重新训练或修改架构即可引入语言特定的每字符时长统计。在双语和多语言 A-DMA 模型上的实验显示,语音自然度、可懂度和说话人相似度均有提升,同时时长失配减少。数据集与代码配方已公开。
正文
Abstract:Recent alignment-free Text-to-Speech (TTS) models achieve high synthesis quality by removing explicit alignment modules and simplifying training. However, they often struggle in cross-lingual scenarios due to differences in character durations across languages, leading to duration mismatch and degraded speech quality. Existing approaches typically address this issue using explicit duration predictors, increasing model complexity. Systematic evaluation of TTS performance for Indian languages in cross-lingual settings remains under-explored due to the lack of standardized evaluation benchmarks. In this work, we construct a cross-lingual evaluation benchmark covering English and nine Indian languages and propose a language-aware inference-time duration estimation strategy for alignment-free TTS that incorporates language-specific duration-per character statistics without retraining or architectural modifications. We further develop heuristic formulations that refine duration estimation based on language-dependent duration variations. Experiments on bilingual and multilingual A-DMA models demonstrate improved speech naturalness, intelligibility, and speaker similarity while reducing duration mismatch.
| Comments: | 9 pages, 3 figures, 5 tables. Accepted at the AACL-IJCNLP 2026 Workshop Multi-LLL. The dataset and code recipes are available at: this https URL |
| Subjects: | Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD) |
| Cite as: | arXiv:2610.14826 [eess.AS] |
| (or arXiv:2610.14826v1 [eess.AS] for this version) | |
| https://doi.org/10.48550/arXiv.2610.14826 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Adarsh Arigala [view email]
[v1]
Sat, 10 Oct 2026 11:41:56 UTC (77 KB)
来源:arXiv:cs.AI · arxiv.org