2603.25551v1 Mar 26, 2026 cs.AI

Voxtral TTS

Voxtral TTS

Thibaut Lavril
Thibaut Lavril
Citations: 43,789
h-index: 18
Baptiste Rozière
Baptiste Rozière
Citations: 25,053
h-index: 21
Guillaume Lample
Guillaume Lample
Citations: 41,837
h-index: 27
Diego de Las Casas
Diego de Las Casas
Citations: 16,815
h-index: 13
Olivier Duchenne
Olivier Duchenne
Citations: 15,536
h-index: 14
Romain Sauvestre
Romain Sauvestre
Citations: 14,205
h-index: 9
Am'elie H'eliou
Am'elie H'eliou
Citations: 1,264
h-index: 9
Andrew Zhao
Andrew Zhao
Tsinghua University
Citations: 1,843
h-index: 11
Andy Ehrenberg
Andy Ehrenberg
Citations: 43
h-index: 3
A. Lo
A. Lo
Citations: 187
h-index: 4
Jean-Malo Delignon
Jean-Malo Delignon
Citations: 39
h-index: 3
Patrick von Platen
Patrick von Platen
Citations: 9,284
h-index: 15
Pavankumar Reddy Muddireddy
Pavankumar Reddy Muddireddy
Citations: 1
h-index: 1
Sanchit Gandhi
Sanchit Gandhi
Citations: 3,132
h-index: 8
Sandeep Subramanian
Sandeep Subramanian
Citations: 1,920
h-index: 5
Srijan Mishra
Srijan Mishra
Citations: 59
h-index: 5
Abhinav Rastogi
Abhinav Rastogi
Google Research
Citations: 6,287
h-index: 21
Alan Jeffares
Alan Jeffares
Citations: 180
h-index: 8
Alexandre Sablayrolles
Alexandre Sablayrolles
Citations: 5,445
h-index: 12
A. Bai
A. Bai
Citations: 9
h-index: 1
Angele Lenglemetz
Angele Lenglemetz
Citations: 1
h-index: 1
Anmol Agarwal
Anmol Agarwal
Citations: 39
h-index: 3
Anton Eliseev
Anton Eliseev
Citations: 16
h-index: 1
Antonia Calvi
Antonia Calvi
Citations: 37
h-index: 2
Baptiste Bout
Baptiste Bout
Citations: 57
h-index: 4
Baudouin De Monicault
Baudouin De Monicault
Citations: 54
h-index: 4
Benjamin Tibi
Benjamin Tibi
Citations: 1
h-index: 1
Clémence Lanfranchi
Clémence Lanfranchi
Citations: 62
h-index: 5
Connor Chen
Connor Chen
Citations: 107
h-index: 4
Corentin Barreau
Corentin Barreau
Citations: 37
h-index: 3
Corentin Sautier
Corentin Sautier
ENPC
Citations: 316
h-index: 5
Cyprien Courtot
Cyprien Courtot
Citations: 18
h-index: 2
Darius Dabert
Darius Dabert
Citations: 48
h-index: 3
Elliot Chane-Sane
Elliot Chane-Sane
Citations: 126
h-index: 6
Enguerrand Paquin
Enguerrand Paquin
Citations: 1
h-index: 1
Federico Baldassarre
Federico Baldassarre
Citations: 1
h-index: 1
Gabrielle Berrada
Gabrielle Berrada
Citations: 57
h-index: 4
Gaetan Ecrepont
Gaetan Ecrepont
Citations: 16
h-index: 1
Gauthier Guinet
Gauthier Guinet
Citations: 84
h-index: 5
G. Hayes
G. Hayes
Citations: 15
h-index: 1
Guillaume Martin
Guillaume Martin
Citations: 25
h-index: 2
Gunjan Dhanuka
Gunjan Dhanuka
Citations: 5
h-index: 1
Gunshi Gupta
Gunshi Gupta
Citations: 245
h-index: 7
Indraneel Mukherjee
Indraneel Mukherjee
Citations: 303
h-index: 6
Jan Ludziejewski
Jan Ludziejewski
Citations: 307
h-index: 7
Jason Rute
Jason Rute
Citations: 87
h-index: 6
Joachim Studnia
Joachim Studnia
Citations: 202
h-index: 5
Jonas Amar
Jonas Amar
Citations: 25
h-index: 2
Julien Tauran
Julien Tauran
Citations: 1
h-index: 1
Karmesh Yadav
Karmesh Yadav
Citations: 25
h-index: 2
Kartik Khandelwal
Kartik Khandelwal
Citations: 65
h-index: 5
Kush Jain
Kush Jain
Citations: 60
h-index: 5
Laurence Aitchison
Laurence Aitchison
Citations: 130
h-index: 5
Léonard Blier
Léonard Blier
Citations: 326
h-index: 6
Lingxiao Zhao
Lingxiao Zhao
Citations: 292
h-index: 6
L. Martin
L. Martin
Citations: 170
h-index: 3
Lucile Saulnier
Lucile Saulnier
Citations: 8,876
h-index: 12
Luyu Gao
Luyu Gao
Citations: 54
h-index: 4
M. Buyl
M. Buyl
Citations: 360
h-index: 10
Manan Sharma
Manan Sharma
Citations: 8
h-index: 2
Marie Pellat
Marie Pellat
Citations: 10,864
h-index: 10
Mark Prins
Mark Prins
Citations: 16
h-index: 1
Mathieu Poir'ee
Mathieu Poir'ee
Citations: 16
h-index: 1
Mathilde Guillaumin
Mathilde Guillaumin
Citations: 54
h-index: 4
Matthieu Dinot
Matthieu Dinot
Citations: 73
h-index: 5
Matthieu Futeral
Matthieu Futeral
Citations: 126
h-index: 5
Maxime Darrin
Maxime Darrin
Citations: 101
h-index: 6
Maximilian Augustin
Maximilian Augustin
Citations: 25
h-index: 2
Mert Unsal
Mert Unsal
Citations: 137
h-index: 3
Mia Chiquier
Mia Chiquier
Citations: 67
h-index: 4
Nathan Grinsztajn
Nathan Grinsztajn
Citations: 530
h-index: 12
Patricia Wang
Patricia Wang
Citations: 88
h-index: 5
Paul Jacob
Paul Jacob
Citations: 198
h-index: 5
P. Wambergue
P. Wambergue
Citations: 59
h-index: 5
Paula Kurylowicz
Paula Kurylowicz
Citations: 84
h-index: 5
Philomène Chagniot
Philomène Chagniot
Citations: 59
h-index: 4
Pierre Stock
Pierre Stock
Citations: 5,248
h-index: 9
Piotr Milo's
Piotr Milo's
Citations: 26
h-index: 2
Pravesh Agrawal
Pravesh Agrawal
Citations: 187
h-index: 4
Quentin Torroba
Quentin Torroba
Citations: 16
h-index: 1
Ram Ramrakhya
Ram Ramrakhya
Citations: 181
h-index: 7
R. Shah
R. Shah
Citations: 17
h-index: 1
Roman Soletskyi
Roman Soletskyi
Citations: 459
h-index: 8
S. Vaze
S. Vaze
Citations: 1,652
h-index: 14
Samuel Humeau
Samuel Humeau
Citations: 2,046
h-index: 15
Siddharth Gandhi
Siddharth Gandhi
Citations: 97
h-index: 6
Sumukh Aithal
Sumukh Aithal
Citations: 60
h-index: 5
Szymon Antoniak
Szymon Antoniak
Citations: 2,125
h-index: 7
Teven Le Scao
Teven Le Scao
Citations: 16,981
h-index: 21
Théo Cachet
Théo Cachet
Citations: 40
h-index: 3
Theo Simon Sorg
Theo Simon Sorg
Citations: 16
h-index: 1
Thomas Chabal
Thomas Chabal
Citations: 58
h-index: 3
Thomas Foubert
Thomas Foubert
Citations: 71
h-index: 4
Thomas Robert
Thomas Robert
Citations: 25
h-index: 2
Thomas Wang
Thomas Wang
Citations: 1,940
h-index: 6
Tim Lawson
Tim Lawson
University of Bristol
Citations: 63
h-index: 4
Tom Bewley
Tom Bewley
Citations: 68
h-index: 6
Tom Edwards
Tom Edwards
Citations: 16
h-index: 1
T. Wang
T. Wang
Citations: 1
h-index: 1
Valeriia Nemychnikova
Valeriia Nemychnikova
Citations: 55
h-index: 4
Vedant Nanda
Vedant Nanda
Citations: 382
h-index: 8
Victor Jouault
Victor Jouault
Citations: 16
h-index: 1
Virgile Richard
Virgile Richard
Citations: 54
h-index: 4
Vladislav V. Bataev
Vladislav V. Bataev
Citations: 1
h-index: 1
Wassim Bouaziz
Wassim Bouaziz
Citations: 514
h-index: 5
Wen-Ding Li
Wen-Ding Li
Citations: 54
h-index: 4
William Marshall
William Marshall
Citations: 194
h-index: 5
Xinghui Li
Xinghui Li
Citations: 17
h-index: 1
Xingran Guo
Xingran Guo
Citations: 10
h-index: 2
Yannic Neuhaus
Yannic Neuhaus
Citations: 68
h-index: 4
Yihan Wang
Yihan Wang
Citations: 23
h-index: 2
Zaccharie Ramzi
Zaccharie Ramzi
Citations: 727
h-index: 13
T. K. Vangani
T. K. Vangani
Citations: 16
h-index: 3
J. S. Roberts
J. S. Roberts
Citations: 126
h-index: 6
Hang Zhou
Hang Zhou
Citations: 56
h-index: 3
Alexander H. Liu
Alexander H. Liu
Citations: 85
h-index: 2
Alexis Tacnet
Alexis Tacnet
Citations: 1
h-index: 1
Chenjing Sun
Chenjing Sun
Citations: 8
h-index: 1
H. Lagarde
H. Lagarde
Citations: 0
h-index: 0
John Harvill
John Harvill
University of Illinois at Urbana-Champaign
Citations: 136
h-index: 7
Khyathi Raghavi Chandu
Khyathi Raghavi Chandu
Citations: 3,542
h-index: 21
Lorenzo Signoretti
Lorenzo Signoretti
Citations: 0
h-index: 0
M. Jennings
M. Jennings
Citations: 333
h-index: 3
Rohin Arora
Rohin Arora
Citations: 42
h-index: 1
V. Phung
V. Phung
Citations: 0
h-index: 0
Abdelaziz Bounhar
Abdelaziz Bounhar
Citations: 5
h-index: 1
Adrien Sad'e
Adrien Sad'e
Citations: 39
h-index: 2
A. Jiang
A. Jiang
Citations: 1
h-index: 1
Alexandre Cahill
Alexandre Cahill
Citations: 15
h-index: 1
A. Gavaudan
A. Gavaudan
Citations: 16
h-index: 1
Amos You
Amos You
Citations: 34
h-index: 3
Arjun Majumdar
Arjun Majumdar
Citations: 2,412
h-index: 15
A. Fournier
A. Fournier
Citations: 17
h-index: 2
Artjom Joosen
Artjom Joosen
Citations: 141
h-index: 5
A. Sooriyarachchi
A. Sooriyarachchi
Citations: 105
h-index: 2
Aysenur Karaduman Utkur
Aysenur Karaduman Utkur
Citations: 0
h-index: 0
Bowen Yang
Bowen Yang
Citations: 680
h-index: 5
Charlotte Cronjager
Charlotte Cronjager
Citations: 0
h-index: 0
E. Demyanenko
E. Demyanenko
Citations: 42
h-index: 2
E. Gottlob
E. Gottlob
Citations: 2
h-index: 1
Etienne Goffinet
Etienne Goffinet
Citations: 1
h-index: 1
F. Niel
F. Niel
Citations: 192
h-index: 6
Faruk Ahmed
Faruk Ahmed
Citations: 2,398
h-index: 1
G. Novikov
G. Novikov
Citations: 0
h-index: 0
Giada Pistilli
Giada Pistilli
Citations: 7
h-index: 1
Guillaume Kunsch
Guillaume Kunsch
Citations: 87
h-index: 3
Guillaume Raille
Guillaume Raille
Citations: 300
h-index: 2
Harshil Shah
Harshil Shah
University College London
Citations: 98
h-index: 4
Hope McGovern
Hope McGovern
Citations: 69
h-index: 3
Hugo Thimonier
Hugo Thimonier
Citations: 64
h-index: 6
Jacques Sun
Jacques Sun
Citations: 0
h-index: 0
J. Dentan
J. Dentan
Citations: 5
h-index: 1
Joséphine Delas
Joséphine Delas
Citations: 53
h-index: 4
Kilian Tep
Kilian Tep
Citations: 0
h-index: 0
Laurent Fainsin
Laurent Fainsin
Citations: 15
h-index: 1
M. Alexandre
M. Alexandre
Citations: 4
h-index: 1
Mathieu Schmitt
Mathieu Schmitt
Citations: 4
h-index: 1
Mikhail Biriuchinskii
Mikhail Biriuchinskii
Citations: 0
h-index: 0
Minh-Quang Pham
Minh-Quang Pham
Citations: 20
h-index: 3
Mircea Lica
Mircea Lica
Citations: 19
h-index: 3
M. Rivière
M. Rivière
Citations: 3,349
h-index: 18
Neha Gupta
Neha Gupta
Citations: 24
h-index: 2
O. Bousquet
O. Bousquet
Citations: 27,869
h-index: 55
Philippe Pinel
Philippe Pinel
Citations: 190
h-index: 1
R. Isenhour
R. Isenhour
Citations: 0
h-index: 0
Rosalie Millner
Rosalie Millner
Citations: 0
h-index: 0
Rupert Menneer
Rupert Menneer
Citations: 16
h-index: 1
Samuel Barry
Samuel Barry
Citations: 25
h-index: 2
Samuel Belkadi
Samuel Belkadi
Citations: 56
h-index: 5
S. Cha
S. Cha
Citations: 0
h-index: 0
Shashwat Verma
Shashwat Verma
Citations: 54
h-index: 3
Siddhant Waghjale
Siddhant Waghjale
Citations: 39
h-index: 2
Simon Lepage
Simon Lepage
CRITEO AI Lab
Citations: 7
h-index: 2
Umar Jamil
Umar Jamil
Citations: 43
h-index: 3
Umberto M. Tomasini
Umberto M. Tomasini
EPFL
Citations: 113
h-index: 6
V. Maladiere
V. Maladiere
Citations: 24
h-index: 2
V. Pfister
V. Pfister
Citations: 52
h-index: 2
William Havard
William Havard
Citations: 1
h-index: 1
Xinyu Yang
Xinyu Yang
Citations: 66
h-index: 2
Yassine El Ouahidi
Yassine El Ouahidi
Citations: 48
h-index: 4
Yassir Bendou
Yassir Bendou
Citations: 125
h-index: 3
Zhe Xu
Zhe Xu
Citations: 0
h-index: 0
Jaeyoung Kim
Jaeyoung Kim
Citations: 2
h-index: 1
Prateek Gupta
Prateek Gupta
Citations: 565
h-index: 9
Yi Pan
Yi Pan
Citations: 1
h-index: 1
Soham Ghosh
Soham Ghosh
Google;Mistral AI;Carnegie Mellon University
Citations: 527
h-index: 8
I. Zhang
I. Zhang
Citations: 0
h-index: 0

본 논문에서는 Voxtral TTS를 소개합니다. Voxtral TTS는 3초 정도의 짧은 참조 오디오만으로도 자연스러운 음성을 생성하는, 표현력이 풍부한 다국어 텍스트 음성 변환 모델입니다. Voxtral TTS는 의미론적 음성 토큰의 자동 회귀 생성과 음향 토큰의 플로우 매칭을 결합한 하이브리드 아키텍처를 채택합니다. 이러한 토큰은 처음부터 하이브리드 VQ-FSQ 양자화 방식을 사용하여 학습된 음성 토크나이저인 Voxtral Codec를 사용하여 인코딩 및 디코딩됩니다. 원어민 평가에서 Voxtral TTS는 자연스러움과 표현력으로 인해 ElevenLabs Flash v2.5보다 68.4%의 우수한 성능을 보였으며, 다국어 음성 복제에 더 선호되었습니다. 본 모델의 가중치는 CC BY-NC 라이선스하에 공개됩니다.

Original Abstract

We introduce Voxtral TTS, an expressive multilingual text-to-speech model that generates natural speech from as little as 3 seconds of reference audio. Voxtral TTS adopts a hybrid architecture that combines auto-regressive generation of semantic speech tokens with flow-matching for acoustic tokens. These tokens are encoded and decoded with Voxtral Codec, a speech tokenizer trained from scratch with a hybrid VQ-FSQ quantization scheme. In human evaluations conducted by native speakers, Voxtral TTS is preferred for multilingual voice cloning due to its naturalness and expressivity, achieving a 68.4\% win rate over ElevenLabs Flash v2.5. We release the model weights under a CC BY-NC license.

0 Citations
0 Influential
27.5 Altmetric
137.5 Score
Original PDF

No Analysis Report Yet

This paper hasn't been analyzed by Gemini yet.

Log in to request an AI analysis.

댓글

댓글을 작성하려면 로그인하세요.

아직 댓글이 없습니다. 첫 번째 댓글을 남겨보세요!