2605.27258v1 May 26, 2026 cs.SD

PilotTTS: A Disciplined Modular Recipe for Competitive Speech Synthesis

Ming Jin
Ming Jin
Citations: 20
h-index: 3
Yang Xiang
Yang Xiang
Citations: 29
h-index: 3
Wei Xiong
Wei Xiong
Citations: 74
h-index: 2
Bowen Li
Bowen Li
Citations: 55
h-index: 2
Shaotong Guo
Shaotong Guo
Citations: 14
h-index: 2
Zhen Wang
Zhen Wang
Citations: 0
h-index: 0
Yihang Lin
Yihang Lin
Citations: 8
h-index: 2
Jiahui Zhao
Jiahui Zhao
Citations: 47
h-index: 3
Dongrui Zhang
Dongrui Zhang
Citations: 3
h-index: 1
Ke Chen
Ke Chen
Citations: 2
h-index: 1
Yun Gao
Yun Gao
Citations: 12
h-index: 2
Zeyang Lin
Zeyang Lin
Citations: 3
h-index: 1
Yuze Zhou
Yuze Zhou
Citations: 2
h-index: 1
Yue Liu
Yue Liu
Citations: 2
h-index: 1

Building state-of-the-art text-to-speech (TTS) systems typically demands millions of hours of proprietary data and complex multi-stage architectures, creating substantial barriers for resource-constrained research teams. In this report, we present PilotTTS, a lightweight autoregressive TTS system that achieves competitive performance through minimalist architecture and rigorous data engineering. PilotTTS is trained on only 200K hours of data processed entirely with open-source tools. Specifically, our contributions are: (1) a reproducible multi-stage data processing pipeline covering quality assessment, label annotation, and filtering, and (2) a compact model architecture that employs Q-Former-based conditioning to decouple speaker identity from speaking style via cross-sample paired training. Within a unified framework, PilotTTS supports zero-shot voice cloning, emotion synthesis (11 categories), paralinguistic synthesis (4 categories), and Chinese dialect synthesis (14 dialects). On the Seed-TTS Eval benchmark, PilotTTS achieves the lowest WER of 1.50% on test-en, a CER of 0.87% on test-zh, and the highest speaker similarity on both test sets (0.862 and 0.815), outperforming systems trained on significantly larger datasets. We release the complete data pipeline recipe, pretrained weights, and code at https://github.com/AMAPVOICE/PilotTTS.

0 Citations
0 Influential
31.897207708399 Altmetric
159.5 Score
Original PDF
7

No Analysis Report Yet

This paper hasn't been analyzed by Gemini yet.

Log in to request an AI analysis.

댓글

댓글을 작성하려면 로그인하세요.

아직 댓글이 없습니다. 첫 번째 댓글을 남겨보세요!