2407.21783
Jul 31, 2024
cs.AI
Llama 3 모델군(The Llama 3 Herd of Models)
The Llama 3 Herd of Models
X. Martinet
X. Martinet
Citations:
54,329
h-index:
10
Aur'elien Rodriguez
Aur'elien Rodriguez
Citations:
54,290
h-index:
9
Yujia Liu
Yujia Liu
Citations:
0
h-index:
0
Todor Mihaylov
Todor Mihaylov
Citations:
43,272
h-index:
26
Punit Singh Koura
Punit Singh Koura
Citations:
39,382
h-index:
10
M. Tsimpoukelli
M. Tsimpoukelli
Citations:
19,709
h-index:
8
Abhimanyu Dubey
Abhimanyu Dubey
Facebook AI Research
Citations:
18,787
h-index:
24
Abhinav Jauhri
Abhinav Jauhri
Citations:
16,423
h-index:
11
Abhinav Pandey
Abhinav Pandey
Citations:
16,470
h-index:
10
Abhishek Kadian
Abhishek Kadian
Citations:
19,924
h-index:
14
Ahmad Al-Dahle
Ahmad Al-Dahle
Citations:
16,365
h-index:
10
Aiesha Letman
Aiesha Letman
Citations:
16,338
h-index:
9
Akhil Mathur
Akhil Mathur
Citations:
16,313
h-index:
9
A. Schelten
A. Schelten
Citations:
33,742
h-index:
11
Amy Yang
Amy Yang
Citations:
16,890
h-index:
10
Angela Fan
Angela Fan
Citations:
16,746
h-index:
6
Anirudh Goyal
Anirudh Goyal
Citations:
16,381
h-index:
10
Anthony S. Hartshorn
Anthony S. Hartshorn
Citations:
16,324
h-index:
8
Aobo Yang
Aobo Yang
Citations:
16,433
h-index:
10
Archi Mitra
Archi Mitra
Citations:
16,319
h-index:
9
A. Sravankumar
A. Sravankumar
Citations:
16,313
h-index:
9
A. Korenev
A. Korenev
Citations:
33,555
h-index:
9
Arthur Hinsvark
Arthur Hinsvark
Citations:
16,350
h-index:
9
Arun Rao
Arun Rao
Citations:
16,292
h-index:
8
Aston Zhang
Aston Zhang
Citations:
16,355
h-index:
10
Austen Gregerson
Austen Gregerson
Citations:
16,307
h-index:
9
Ava Spataru
Ava Spataru
Citations:
16,373
h-index:
9
Baptiste Rozière
Baptiste Rozière
Citations:
16,622
h-index:
11
B. Biron
B. Biron
Citations:
16,812
h-index:
12
Binh Tang
Binh Tang
Citations:
16,517
h-index:
9
Bobbie Chern
Bobbie Chern
Citations:
16,342
h-index:
9
Charlotte Caucheteux
Charlotte Caucheteux
Citations:
16,307
h-index:
9
Chaya Nayak
Chaya Nayak
Citations:
16,362
h-index:
9
Chloe Bi
Chloe Bi
Citations:
16,416
h-index:
10
Chris Marra
Chris Marra
Citations:
16,307
h-index:
9
Chris McConnell
Chris McConnell
Citations:
16,335
h-index:
9
Christian Keller
Christian Keller
Citations:
16,383
h-index:
10
C. Touret
C. Touret
Citations:
16,599
h-index:
9
Chunyang Wu
Chunyang Wu
Citations:
16,307
h-index:
9
C. Wong
C. Wong
Citations:
16,589
h-index:
9
Cristian Canton Ferrer
Cristian Canton Ferrer
Citations:
38,327
h-index:
15
Cyrus Nikolaidis
Cyrus Nikolaidis
Citations:
16,681
h-index:
11
Damien Allonsius
Damien Allonsius
Citations:
16,216
h-index:
8
D. Song
D. Song
Citations:
16,720
h-index:
11
D. Pintz
D. Pintz
Citations:
16,307
h-index:
9
D. Livshits
D. Livshits
Citations:
16,325
h-index:
9
David Esiobu
David Esiobu
Citations:
33,922
h-index:
12
Dhruv Choudhary
Dhruv Choudhary
Citations:
17,458
h-index:
11
Dhruv Mahajan
Dhruv Mahajan
Citations:
16,423
h-index:
10
Diego Garcia-Olano
Diego Garcia-Olano
University of Texas at Austin
Citations:
16,486
h-index:
6
Diego Perino
Diego Perino
Citations:
16,304
h-index:
9
Dieuwke Hupkes
Dieuwke Hupkes
Citations:
22,042
h-index:
29
Egor Lakomkin
Egor Lakomkin
Citations:
16,721
h-index:
12
Ehab A. AlBadawy
Ehab A. AlBadawy
Citations:
16,307
h-index:
9
E. Lobanova
E. Lobanova
Citations:
16,301
h-index:
9
Emily Dinan
Emily Dinan
Citations:
25,459
h-index:
26
E. Smith
E. Smith
Citations:
16,457
h-index:
10
Filip Radenovic
Filip Radenovic
Meta AI
Citations:
21,196
h-index:
23
Frank Zhang
Frank Zhang
Citations:
16,329
h-index:
9
Gabrielle Lee
Gabrielle Lee
Citations:
16,288
h-index:
8
Georgia Lewis Anderson
Georgia Lewis Anderson
Citations:
16,256
h-index:
7
G. Nail
G. Nail
Citations:
16,370
h-index:
9
G. Mialon
G. Mialon
Citations:
18,518
h-index:
14
Guanglong Pang
Guanglong Pang
Citations:
16,083
h-index:
2
Guillem Cucurell
Guillem Cucurell
Citations:
16,282
h-index:
8
Hailey Nguyen
Hailey Nguyen
Citations:
16,376
h-index:
10
Hannah Korevaar
Hannah Korevaar
Citations:
16,208
h-index:
6
Hu Xu
Hu Xu
Citations:
16,325
h-index:
9
Hugo Touvron
Hugo Touvron
Citations:
16,444
h-index:
10
Iliyan Zarov
Iliyan Zarov
Citations:
33,381
h-index:
5
Imanol Arrieta Ibarra
Imanol Arrieta Ibarra
Citations:
16,175
h-index:
3
Isabel M. Kloumann
Isabel M. Kloumann
Citations:
36,874
h-index:
18
Ishan Misra
Ishan Misra
Citations:
17,693
h-index:
13
Ivan Evtimov
Ivan Evtimov
Citations:
17,028
h-index:
13
Jade Copet
Jade Copet
Citations:
24,013
h-index:
22
Jaewon Lee
Jaewon Lee
Citations:
16,262
h-index:
9
Jan Geffert
Jan Geffert
Citations:
16,301
h-index:
9
Jana Vranes
Jana Vranes
Citations:
16,271
h-index:
7
Jason Park
Jason Park
Citations:
16,293
h-index:
8
Jay Mahadeokar
Jay Mahadeokar
Citations:
18,506
h-index:
19
Jeet Shah
Jeet Shah
Citations:
16,245
h-index:
7
J. V. D. Linde
J. V. D. Linde
Citations:
16,492
h-index:
10
Jennifer Billock
Jennifer Billock
Citations:
16,247
h-index:
7
Jenny Hong
Jenny Hong
Citations:
16,239
h-index:
7
Jenya Lee
Jenya Lee
Citations:
33,687
h-index:
9
Jianfeng Chi
Jianfeng Chi
Citations:
17,893
h-index:
16
Jianyu Huang
Jianyu Huang
Citations:
16,322
h-index:
9
Jiawen Liu
Jiawen Liu
Citations:
16,269
h-index:
8
Jie Wang
Jie Wang
Citations:
16,289
h-index:
9
Jiecao Yu
Jiecao Yu
Citations:
16,466
h-index:
10
Joanna Bitton
Joanna Bitton
Citations:
21,028
h-index:
12
Joe Spisak
Joe Spisak
Citations:
17,928
h-index:
9
Jongsoo Park
Jongsoo Park
Citations:
17,731
h-index:
10
Joseph Rocca
Joseph Rocca
Citations:
16,244
h-index:
7
J. Johnstun
J. Johnstun
Citations:
16,247
h-index:
7
Joshua Saxe
Joshua Saxe
Citations:
16,793
h-index:
10
Ju-Qing Jia
Ju-Qing Jia
Citations:
16,271
h-index:
5
Kalyan Vasuden Alwala
Kalyan Vasuden Alwala
Citations:
16,230
h-index:
6
K. Upasani
K. Upasani
Citations:
17,579
h-index:
10
Kate Plawiak
Kate Plawiak
Citations:
16,395
h-index:
9
Keqian Li
Keqian Li
Citations:
32,377
h-index:
9
Kenneth Heafield
Kenneth Heafield
Citations:
25,657
h-index:
34
Kevin R. Stone
Kevin R. Stone
Citations:
17,013
h-index:
9
Khalid El-Arini
Khalid El-Arini
Citations:
16,643
h-index:
11
Krithika Iyer
Krithika Iyer
Citations:
17,350
h-index:
8
Kshitiz Malik
Kshitiz Malik
Citations:
16,583
h-index:
7
K. Chiu
K. Chiu
Citations:
16,235
h-index:
6
Kunal Bhalla
Kunal Bhalla
Citations:
16,235
h-index:
6
Lauren Rantala-Yeary
Lauren Rantala-Yeary
Citations:
16,238
h-index:
6
L. Maaten
L. Maaten
Citations:
92,593
h-index:
51
Lawrence Chen
Lawrence Chen
Citations:
16,247
h-index:
7
Liang Tan
Liang Tan
Citations:
16,671
h-index:
9
Liz Jenkins
Liz Jenkins
Citations:
16,235
h-index:
6
Louis Martin
Louis Martin
Citations:
16,806
h-index:
9
Lovish Madaan
Lovish Madaan
Citations:
16,643
h-index:
12
L. Malo
L. Malo
Citations:
16,277
h-index:
6
Lukas Blecher
Lukas Blecher
Citations:
33,985
h-index:
11
Lukas Landzaat
Lukas Landzaat
Citations:
16,252
h-index:
7
L. Oliveira
L. Oliveira
Citations:
16,221
h-index:
6
M. Muzzi
M. Muzzi
Citations:
16,222
h-index:
6
Ma-hesh Pasupuleti
Ma-hesh Pasupuleti
Citations:
16,412
h-index:
9
Mannat Singh
Mannat Singh
Facebook AI Research (FAIR)
Citations:
21,875
h-index:
14
Manohar Paluri
Manohar Paluri
Citations:
35,429
h-index:
28
Marcin Kardas
Marcin Kardas
Citations:
34,905
h-index:
10
Mathew Oldham
Mathew Oldham
Citations:
16,229
h-index:
6
Mathieu Rita
Mathieu Rita
Citations:
16,267
h-index:
8
Maya Pavlova
Maya Pavlova
Citations:
16,333
h-index:
8
M. Kambadur
M. Kambadur
Citations:
34,217
h-index:
12
Mike Lewis
Mike Lewis
Citations:
16,646
h-index:
9
Min Si
Min Si
Citations:
16,126
h-index:
5
Mitesh Kumar Singh
Mitesh Kumar Singh
Citations:
17,003
h-index:
6
Mona Hassan
Mona Hassan
Citations:
16,224
h-index:
6
Narjes Torabi
Narjes Torabi
Citations:
16,449
h-index:
11
Niko-lay Bashlykov
Niko-lay Bashlykov
Citations:
33,720
h-index:
10
Nikolay Bogoychev
Nikolay Bogoychev
Citations:
17,647
h-index:
17
Niladri S. Chatterji
Niladri S. Chatterji
Citations:
26,418
h-index:
23
Olivier Duchenne
Olivier Duchenne
Citations:
17,932
h-index:
14
Onur cCelebi
Onur cCelebi
Citations:
17,994
h-index:
4
Patrick Alrassy
Patrick Alrassy
Citations:
16,281
h-index:
8
Pengchuan Zhang
Pengchuan Zhang
Citations:
16,731
h-index:
9
Pengwei Li
Pengwei Li
Citations:
16,646
h-index:
9
Petar Vasić
Petar Vasić
Citations:
16,219
h-index:
6
Peter Weng
Peter Weng
Citations:
16,252
h-index:
7
Prajjwal Bhargava
Prajjwal Bhargava
Citations:
34,340
h-index:
13
P. Dubal
P. Dubal
Citations:
16,284
h-index:
8
Praveen Krishnan
Praveen Krishnan
Citations:
16,107
h-index:
3
Puxin Xu
Puxin Xu
Citations:
35,073
h-index:
11
Q. He
Q. He
Citations:
16,204
h-index:
6
Qingxiao Dong
Qingxiao Dong
Citations:
16,239
h-index:
6
R. Srinivasan
R. Srinivasan
Citations:
16,226
h-index:
6
R. Ganapathy
R. Ganapathy
Citations:
16,290
h-index:
8
Ramon Calderer
Ramon Calderer
Citations:
16,571
h-index:
12
Ricardo Silveira Cabral
Ricardo Silveira Cabral
Citations:
16,368
h-index:
9
Robert Stojnic
Robert Stojnic
Citations:
35,163
h-index:
13
R. Raileanu
R. Raileanu
Citations:
25,277
h-index:
30
Rohit Girdhar
Rohit Girdhar
Facebook AI Research
Citations:
31,529
h-index:
31
Rohit Patel
Rohit Patel
Citations:
16,253
h-index:
7
Romain Sauvestre
Romain Sauvestre
Citations:
16,558
h-index:
10
Ron-nie Polidoro
Ron-nie Polidoro
Citations:
16,237
h-index:
6
Roshan Sumbaly
Roshan Sumbaly
Citations:
17,278
h-index:
11
Ross Taylor
Ross Taylor
Citations:
34,624
h-index:
9
Ruan Silva
Ruan Silva
Citations:
33,574
h-index:
9
Rui Hou
Rui Hou
Citations:
16,897
h-index:
8
Rui Wang
Rui Wang
Citations:
16,537
h-index:
7
S. Hosseini
S. Hosseini
Citations:
16,596
h-index:
10
Sa-hana Chennabasappa
Sa-hana Chennabasappa
Citations:
16,633
h-index:
10
Sanjay Singh
Sanjay Singh
Citations:
16,257
h-index:
7
Sean Bell
Sean Bell
Citations:
16,782
h-index:
7
S. Kim
S. Kim
Citations:
16,079
h-index:
2
Sergey Edunov
Sergey Edunov
Facebook AI Research
Citations:
51,135
h-index:
19
Shaoliang Nie
Shaoliang Nie
Citations:
16,760
h-index:
16
Sharan Narang
Sharan Narang
Citations:
82,679
h-index:
31
S. Raparthy
S. Raparthy
Citations:
16,929
h-index:
12
Sheng Shen
Sheng Shen
University of California, Berkeley
Citations:
28,042
h-index:
34
Shengye Wan
Shengye Wan
Citations:
16,633
h-index:
10
Shruti Bhosale
Shruti Bhosale
Citations:
38,951
h-index:
22
Shun Zhang
Shun Zhang
Citations:
16,273
h-index:
9
Simon Vandenhende
Simon Vandenhende
Citations:
19,499
h-index:
16
Soumya Batra
Soumya Batra
Citations:
33,777
h-index:
12
Spencer Whitman
Spencer Whitman
Citations:
16,640
h-index:
10
Sten Sootla
Sten Sootla
Citations:
19,726
h-index:
12
S. Collot
S. Collot
Citations:
16,251
h-index:
7
Suchin Gururangan
Suchin Gururangan
Allen Institute for AI
Citations:
26,388
h-index:
24
S. Borodinsky
S. Borodinsky
Citations:
16,234
h-index:
6
Tamar Herman
Tamar Herman
Citations:
16,237
h-index:
6
T. Fowler
T. Fowler
Citations:
16,950
h-index:
9
Tarek Sheasha
Tarek Sheasha
Citations:
16,237
h-index:
6
Thomas Georgiou
Thomas Georgiou
Citations:
16,363
h-index:
7
Thomas Scialom
Thomas Scialom
Citations:
39,271
h-index:
17
Tobias Speckbacher
Tobias Speckbacher
Citations:
16,223
h-index:
6
Tong Xiao
Tong Xiao
Citations:
16,269
h-index:
8
Ujjwal Karn
Ujjwal Karn
Facebook
Citations:
16,304
h-index:
6
Vedanuj Goswami
Vedanuj Goswami
Citations:
38,847
h-index:
22
Vibhor Gupta
Vibhor Gupta
Citations:
16,238
h-index:
6
Vignesh Ramanathan
Vignesh Ramanathan
Citations:
23,484
h-index:
24
Viktor Kerkez
Viktor Kerkez
Citations:
34,718
h-index:
9
Vincent Gonguet
Vincent Gonguet
Citations:
16,238
h-index:
6
Virginie Do
Virginie Do
Citations:
16,785
h-index:
16
Vish Vogeti
Vish Vogeti
Citations:
16,576
h-index:
9
Vladan Petrovic
Vladan Petrovic
Citations:
17,233
h-index:
7
Weiwei Chu
Weiwei Chu
Citations:
16,285
h-index:
8
Wenhan Xiong
Wenhan Xiong
Citations:
16,434
h-index:
9
Wenyin Fu
Wenyin Fu
Citations:
33,692
h-index:
9
Whit-ney Meers
Whit-ney Meers
Citations:
16,205
h-index:
6
Xiaodong Wang
Xiaodong Wang
Citations:
17,440
h-index:
8
X. Tan
X. Tan
Citations:
16,593
h-index:
4
Xinfeng Xie
Xinfeng Xie
Citations:
16,375
h-index:
10
Xuchao Jia
Xuchao Jia
Citations:
16,148
h-index:
4
Xuewei Wang
Xuewei Wang
Citations:
16,436
h-index:
9
Yaelle Goldschlag
Yaelle Goldschlag
Citations:
16,253
h-index:
6
Yasmine Babaei
Yasmine Babaei
Citations:
33,765
h-index:
10
Yiqian Wen
Yiqian Wen
Citations:
16,553
h-index:
4
Yiwen Song
Yiwen Song
Citations:
19,311
h-index:
2
Yuchen Zhang
Yuchen Zhang
Meta AI
Citations:
33,621
h-index:
9
Yue Li
Yue Li
Citations:
16,397
h-index:
8
Yuning Mao
Yuning Mao
Citations:
17,516
h-index:
9
Zacharie Delpierre Coudert
Zacharie Delpierre Coudert
Citations:
16,416
h-index:
8
Zhengxu Yan
Zhengxu Yan
Citations:
16,190
h-index:
4
Zhengxing Chen
Zhengxing Chen
Citations:
16,398
h-index:
9
Zoe Papakipos
Zoe Papakipos
Citations:
16,354
h-index:
8
Aaditya K. Singh
Aaditya K. Singh
Citations:
16,262
h-index:
6
Aaron Grattafiori
Aaron Grattafiori
Citations:
19,704
h-index:
11
Abha Jain
Abha Jain
Citations:
16,231
h-index:
5
A. Kelsey
A. Kelsey
Citations:
16,235
h-index:
6
Adam Shajnfeld
Adam Shajnfeld
Citations:
16,220
h-index:
6
Adi Gangidi
Adi Gangidi
Citations:
16,701
h-index:
9
Adolfo Victoria
Adolfo Victoria
Citations:
16,213
h-index:
6
Ahuva Goldstand
Ahuva Goldstand
Citations:
16,205
h-index:
5
A. Menon
A. Menon
Citations:
16,326
h-index:
7
Ajay Sharma
Ajay Sharma
Citations:
16,191
h-index:
4
Alex Boesenberg
Alex Boesenberg
Citations:
16,148
h-index:
4
Alex Vaughan
Alex Vaughan
Citations:
16,259
h-index:
7
Alexei Baevski
Alexei Baevski
Citations:
19,007
h-index:
13
Allie Feinstein
Allie Feinstein
Citations:
16,191
h-index:
4
Amanda Kallet
Amanda Kallet
Citations:
16,819
h-index:
9
Amit Sangani
Amit Sangani
Citations:
16,191
h-index:
4
Anam Yunus
Anam Yunus
Citations:
16,191
h-index:
4
Andrei Lupu
Andrei Lupu
University of Oxford, Meta AI
Citations:
16,810
h-index:
12
Andres Alvarado
Andres Alvarado
Citations:
16,237
h-index:
5
A. Caples
A. Caples
Citations:
16,270
h-index:
6
Andrew Gu
Andrew Gu
Citations:
16,168
h-index:
3
Andrew Ho
Andrew Ho
Citations:
16,217
h-index:
5
Andrew Poulton
Andrew Poulton
Citations:
16,546
h-index:
9
Andrew Ryan
Andrew Ryan
Citations:
16,203
h-index:
5
Ankit Ramchandani
Ankit Ramchandani
Citations:
16,361
h-index:
8
Annie Franco
Annie Franco
Citations:
16,233
h-index:
6
Aparajita Saraf
Aparajita Saraf
Citations:
16,243
h-index:
5
Arkabandhu Chowdhury
Arkabandhu Chowdhury
Citations:
16,233
h-index:
6
Ashley Gabriel
Ashley Gabriel
Citations:
16,219
h-index:
5
Ashwin Bharambe
Ashwin Bharambe
Citations:
16,233
h-index:
6
Assaf Eisenman
Assaf Eisenman
Citations:
17,082
h-index:
12
Azadeh Yazdan
Azadeh Yazdan
Citations:
16,113
h-index:
2
Beau James
Beau James
Citations:
16,219
h-index:
5
Ben Maurer
Ben Maurer
Citations:
16,223
h-index:
5
B. Leonhardi
B. Leonhardi
Citations:
16,290
h-index:
8
Po-Yao (Bernie) Huang
Po-Yao (Bernie) Huang
Facebook AI Research (FAIR)
Citations:
31,353
h-index:
27
Beth Loyd
Beth Loyd
Citations:
16,233
h-index:
6
Beto de Paola
Beto de Paola
Citations:
16,297
h-index:
6
Bhargavi Paranjape
Bhargavi Paranjape
Citations:
17,228
h-index:
14
Bing Liu
Bing Liu
Citations:
19,549
h-index:
9
Bo Wu
Bo Wu
Citations:
16,187
h-index:
5
B. Ni
B. Ni
Citations:
16,213
h-index:
6
Braden Hancock
Braden Hancock
Citations:
16,092
h-index:
2
Bram Wasti
Bram Wasti
Citations:
17,084
h-index:
8
Brandon Spence
Brandon Spence
Citations:
16,182
h-index:
4
B. Stojkovic
B. Stojkovic
Citations:
16,180
h-index:
4
Brian Gamido
Brian Gamido
Citations:
16,182
h-index:
4
Britt Montalvo
Britt Montalvo
Citations:
16,182
h-index:
4
Carl Parker
Carl Parker
Citations:
16,185
h-index:
4
Carly Burton
Carly Burton
Citations:
16,194
h-index:
5
Catalina Mejia
Catalina Mejia
Citations:
16,196
h-index:
5
Changhan Wang
Changhan Wang
Citations:
16,277
h-index:
7
Changkyu Kim
Changkyu Kim
Citations:
16,206
h-index:
6
Chao Zhou
Chao Zhou
Citations:
16,200
h-index:
5
Chester Hu
Chester Hu
Citations:
16,180
h-index:
4
Ching-Hsiang Chu
Ching-Hsiang Chu
Citations:
16,255
h-index:
9
Chris Cai
Chris Cai
Citations:
16,261
h-index:
8
Chris Tindal
Chris Tindal
Citations:
16,316
h-index:
6
Christoph Feichtenhofer
Christoph Feichtenhofer
Citations:
45,545
h-index:
36
Damon Civin
Damon Civin
Citations:
19,472
h-index:
6
D. Beaty
D. Beaty
Citations:
16,180
h-index:
4
Daniel Kreymer
Daniel Kreymer
Citations:
16,179
h-index:
5
Shang-Wen Li
Shang-Wen Li
MIT
Citations:
31,484
h-index:
32
Danny Wyatt
Danny Wyatt
Citations:
16,225
h-index:
6
David Adkins
David Adkins
Citations:
16,180
h-index:
5
David Xu
David Xu
Citations:
16,174
h-index:
5
Davide Testuggine
Davide Testuggine
Citations:
17,225
h-index:
4
Delia David
Delia David
Citations:
16,198
h-index:
5
Devi Parikh
Devi Parikh
Citations:
16,736
h-index:
5
Diana Liskovich
Diana Liskovich
Citations:
33,926
h-index:
9
Didem Foss
Didem Foss
Citations:
16,148
h-index:
4
Dingkang Wang
Dingkang Wang
Citations:
16,648
h-index:
3
Duc Le
Duc Le
Citations:
18,072
h-index:
23
Dustin Holland
Dustin Holland
Citations:
16,087
h-index:
2
Edward Dowling
Edward Dowling
Citations:
16,148
h-index:
4
Eissa Jamil
Eissa Jamil
Citations:
16,134
h-index:
3
Elaine Montgomery
Elaine Montgomery
Citations:
16,128
h-index:
4
Eleonora Presani
Eleonora Presani
Citations:
18,218
h-index:
23
Emily Hahn
Emily Hahn
Citations:
16,191
h-index:
5
Emily Wood
Emily Wood
Citations:
16,191
h-index:
5
Erik Brinkman
Erik Brinkman
Citations:
16,228
h-index:
6
E. Arcaute
E. Arcaute
Citations:
16,990
h-index:
7
Evan Dunbar
Evan Dunbar
Citations:
16,191
h-index:
5
Evan Smothers
Evan Smothers
Citations:
16,181
h-index:
4
Fei Sun
Fei Sun
Citations:
16,346
h-index:
8
F. Kreuk
F. Kreuk
Citations:
18,917
h-index:
19
Feng Tian
Feng Tian
Citations:
16,223
h-index:
6
Firat Ozgenel
Firat Ozgenel
Citations:
16,268
h-index:
5
Francesco Caggioni
Francesco Caggioni
Citations:
16,206
h-index:
6
Francisco (Paco) Guzmán
Francisco (Paco) Guzmán
Handshake AI
Citations:
31,295
h-index:
30
Frank J. Kanayet
Frank J. Kanayet
Citations:
16,282
h-index:
9
Frank Seide
Frank Seide
Citations:
16,280
h-index:
8
Gabriela Medina Florez
Gabriela Medina Florez
Citations:
16,120
h-index:
4
Gabriella Schwarz
Gabriella Schwarz
Citations:
16,191
h-index:
5
Gada Badeer
Gada Badeer
Citations:
16,177
h-index:
4
Georgia Swee
Georgia Swee
Citations:
16,191
h-index:
5
Gil Halpern
Gil Halpern
Citations:
16,196
h-index:
5
Govind Thattai
Govind Thattai
Citations:
16,790
h-index:
16
Grant Herman
Grant Herman
Citations:
16,194
h-index:
5
Grigory Sizov
Grigory Sizov
Citations:
16,976
h-index:
16
Guangyi Zhang
Guangyi Zhang
Citations:
17,731
h-index:
22
G. Lakshminarayanan
G. Lakshminarayanan
Citations:
16,228
h-index:
5
Hamid Shojanazeri
Hamid Shojanazeri
Citations:
16,818
h-index:
3
Han Zou
Han Zou
Citations:
16,211
h-index:
6
Hannah Wang
Hannah Wang
Citations:
16,146
h-index:
4
Han Zha
Han Zha
Citations:
16,103
h-index:
4
Haroun Habeeb
Haroun Habeeb
Citations:
16,148
h-index:
5
Harrison Rudolph
Harrison Rudolph
Citations:
16,091
h-index:
3
Helen Suk
Helen Suk
Citations:
17,280
h-index:
3
Henry Aspegren
Henry Aspegren
Citations:
17,217
h-index:
5
Hunter Goldman
Hunter Goldman
Citations:
16,091
h-index:
3
Igor Molybog
Igor Molybog
Citations:
33,851
h-index:
8
Igor Tufanov
Igor Tufanov
Citations:
16,444
h-index:
6
Irina-Elena Veliche
Irina-Elena Veliche
Citations:
16,185
h-index:
6
Itai Gat
Itai Gat
Meta
Citations:
22,081
h-index:
22
J. Weissman
J. Weissman
Citations:
16,127
h-index:
4
James Geboski
James Geboski
Citations:
16,077
h-index:
2
James Kohli
James Kohli
Citations:
16,091
h-index:
3
Japhet Asher
Japhet Asher
Citations:
16,077
h-index:
2
Jean-Baptiste Gaya
Jean-Baptiste Gaya
Citations:
16,459
h-index:
9
Jeff Marcus
Jeff Marcus
Citations:
16,169
h-index:
4
Jeff Tang
Jeff Tang
Citations:
16,090
h-index:
3
J. Chan
J. Chan
Citations:
16,133
h-index:
4
Jenny Zhen
Jenny Zhen
Citations:
16,130
h-index:
4
J. Reizenstein
J. Reizenstein
Citations:
35,728
h-index:
14
J. Teboul
J. Teboul
Citations:
16,132
h-index:
4
J. Zhong
J. Zhong
Citations:
16,130
h-index:
4
Jian Jin
Jian Jin
Citations:
16,311
h-index:
7
Jingyi Yang
Jingyi Yang
Citations:
16,352
h-index:
6
Joe Cummings
Joe Cummings
Citations:
16,116
h-index:
4
J. Carvill
J. Carvill
Citations:
16,123
h-index:
4
Jon Shepard
Jon Shepard
Citations:
16,240
h-index:
7
J. McPhie
J. McPhie
Citations:
16,170
h-index:
4
J. Torres
J. Torres
Citations:
16,116
h-index:
4
Josh Ginsburg
Josh Ginsburg
Citations:
16,116
h-index:
4
Junjie Wang
Junjie Wang
Citations:
16,132
h-index:
5
Kaixing(Kai) Wu
Kaixing(Kai) Wu
Meta
Citations:
16,152
h-index:
2
U. KamHou
U. KamHou
Citations:
16,077
h-index:
2
Karan Saxena
Karan Saxena
Citations:
16,177
h-index:
6
Karthik Prasad
Karthik Prasad
Citations:
16,172
h-index:
6
Kartikay Khandelwal
Kartikay Khandelwal
Citations:
24,649
h-index:
6
Katayoun Zand
Katayoun Zand
Citations:
16,119
h-index:
4
Kathy Matosich
Kathy Matosich
Citations:
16,132
h-index:
4
K. Veeraraghavan
K. Veeraraghavan
Citations:
16,114
h-index:
4
Kelly Michelena
Kelly Michelena
Citations:
16,118
h-index:
4
Kun Huang
Kun Huang
Citations:
16,154
h-index:
6
Kunal Chawla
Kunal Chawla
Citations:
16,128
h-index:
4
Kushal Lakhotia
Kushal Lakhotia
Citations:
24,982
h-index:
16
Kyle Huang
Kyle Huang
Citations:
16,135
h-index:
4
Lailin Chen
Lailin Chen
Citations:
16,131
h-index:
5
Lakshya Garg
Lakshya Garg
Citations:
16,094
h-index:
3
A. Lavender
A. Lavender
Citations:
16,093
h-index:
3
Leandro Silva
Leandro Silva
Citations:
16,132
h-index:
4
Lee Bell
Lee Bell
Citations:
16,118
h-index:
4
Lei Zhang
Lei Zhang
Citations:
16,132
h-index:
4
Liangpeng Guo
Liangpeng Guo
Citations:
16,122
h-index:
4
Licheng Yu
Licheng Yu
Citations:
16,750
h-index:
7
Liron Moshkovich
Liron Moshkovich
Citations:
16,118
h-index:
4
Luca Wehrstedt
Luca Wehrstedt
Citations:
17,511
h-index:
8
Madian Khabsa
Madian Khabsa
Citations:
41,358
h-index:
30
Manav Avalani
Manav Avalani
Citations:
16,118
h-index:
4
M. Bhatt
M. Bhatt
Citations:
16,403
h-index:
6
Martynas Mankus
Martynas Mankus
Citations:
16,137
h-index:
4
Matan Hasson
Matan Hasson
Citations:
16,142
h-index:
5
M. Lennie
M. Lennie
Citations:
16,250
h-index:
7
Matthias Reso
Matthias Reso
Citations:
17,467
h-index:
8
M. Groshev
M. Groshev
Citations:
16,191
h-index:
5
M. Naumov
M. Naumov
Citations:
16,488
h-index:
8
Maya Lathi
Maya Lathi
Citations:
16,119
h-index:
4
Meghan Keneally
Meghan Keneally
Citations:
16,132
h-index:
4
M. Seltzer
M. Seltzer
Citations:
26,802
h-index:
44
Michal Valko
Michal Valko
Building something new @ Stealth Startup & Inria & MVA - Ex: Llama @AIatMeta Gemini and BYOL @GoogleDeepMind
Citations:
32,150
h-index:
44
Michelle Restrepo
Michelle Restrepo
Citations:
16,080
h-index:
2
M. Patel
M. Patel
Citations:
16,128
h-index:
4
Mik Vyatskov
Mik Vyatskov
Citations:
16,208
h-index:
6
Mikayel Samvelyan
Mikayel Samvelyan
Google DeepMind
Citations:
22,239
h-index:
17
Mike Clark
Mike Clark
Citations:
16,208
h-index:
6
M. Macey
M. Macey
Citations:
16,253
h-index:
7
Mike Wang
Mike Wang
Citations:
16,120
h-index:
4
Miquel Jubert Hermoso
Miquel Jubert Hermoso
Citations:
16,129
h-index:
4
Mo Metanat
Mo Metanat
Citations:
16,194
h-index:
5
Mohammad Rastegari
Mohammad Rastegari
Iran University of Science and Technology
Citations:
17,482
h-index:
15
Mun-ish Bansal
Mun-ish Bansal
Citations:
16,133
h-index:
4
N. Santhanam
N. Santhanam
Citations:
16,143
h-index:
4
Natascha Parks
Natascha Parks
Citations:
16,119
h-index:
4
Natasha White
Natasha White
Citations:
16,119
h-index:
4
Navy-ata Bawa
Navy-ata Bawa
Citations:
16,122
h-index:
4
Nayan Singhal
Nayan Singhal
Citations:
16,638
h-index:
8
Nick Egebo
Nick Egebo
Citations:
16,136
h-index:
4
Nicolas Usunier
Nicolas Usunier
Citations:
55,738
h-index:
46
Nikolay Pavlovich Laptev
Nikolay Pavlovich Laptev
Citations:
16,097
h-index:
3
Ning Dong
Ning Dong
Citations:
16,196
h-index:
3
Ning Zhang
Ning Zhang
Citations:
16,243
h-index:
6
Norman Cheng
Norman Cheng
Citations:
16,129
h-index:
4
Oleg Chernoguz
Oleg Chernoguz
Citations:
16,119
h-index:
4
O. Hart
O. Hart
Citations:
16,118
h-index:
4
Omkar Salpekar
Omkar Salpekar
Citations:
16,419
h-index:
6
Ozlem Kalinli
Ozlem Kalinli
Citations:
17,312
h-index:
17
Parkin Kent
Parkin Kent
Citations:
16,115
h-index:
4
Parth Parekh
Parth Parekh
Citations:
16,130
h-index:
4
Paul Saab
Paul Saab
Citations:
16,191
h-index:
5
Pavan Balaji
Pavan Balaji
Citations:
16,205
h-index:
8
Pe-dro Rittner
Pe-dro Rittner
Citations:
16,149
h-index:
5
Philip Bontrager
Philip Bontrager
Citations:
17,401
h-index:
15
Pierre Roux
Pierre Roux
Citations:
16,132
h-index:
4
Piotr Dollár
Piotr Dollár
Citations:
16,873
h-index:
6
Polina Zvyagina
Polina Zvyagina
Citations:
16,163
h-index:
6
Prashant Ratanchandani
Prashant Ratanchandani
Citations:
16,492
h-index:
5
P. Yuvraj
P. Yuvraj
Citations:
16,340
h-index:
8
Qian Liang
Qian Liang
Citations:
16,291
h-index:
7
Rachad Alao
Rachad Alao
Citations:
16,235
h-index:
7
R. Rodriguez
R. Rodriguez
Citations:
16,211
h-index:
6
Rafi Ayub
Rafi Ayub
Citations:
16,346
h-index:
8
Raghotham Murthy
Raghotham Murthy
Citations:
16,210
h-index:
6
Raghu Nayani
Raghu Nayani
Citations:
16,196
h-index:
5
Rahul Mitra
Rahul Mitra
Citations:
16,217
h-index:
7
Raymond Li
Raymond Li
Citations:
16,234
h-index:
7
Rebekkah Hogan
Rebekkah Hogan
Citations:
16,195
h-index:
5
Robin Battey
Robin Battey
Citations:
16,209
h-index:
6
Rocky Wang
Rocky Wang
Citations:
16,209
h-index:
6
R. Maheswari
R. Maheswari
Citations:
16,183
h-index:
6
Russ Howes
Russ Howes
Citations:
27,087
h-index:
12
Ruty Rinott
Ruty Rinott
Citations:
19,091
h-index:
11
Sai Jayesh Bondu
Sai Jayesh Bondu
Citations:
16,276
h-index:
3
Samyak Datta
Samyak Datta
Citations:
17,908
h-index:
11
Sara Chugh
Sara Chugh
Citations:
16,195
h-index:
5
Sargun Dhillon
Sargun Dhillon
Citations:
16,087
h-index:
2
S. Sidorov
S. Sidorov
Citations:
16,075
h-index:
2
Saurabh Verma
Saurabh Verma
Citations:
16,079
h-index:
2
Seiji Yamamoto
Seiji Yamamoto
Citations:
16,088
h-index:
2
Sharadh Ramaswamy
Sharadh Ramaswamy
Citations:
16,791
h-index:
9
Shaun Lindsay
Shaun Lindsay
Citations:
16,092
h-index:
2
Sheng Feng
Sheng Feng
Citations:
16,219
h-index:
7
Shenghao Lin
Shenghao Lin
Citations:
16,127
h-index:
3
S. Shankar
S. Shankar
Citations:
16,092
h-index:
2
Shuqiang Zhang
Shuqiang Zhang
Citations:
16,439
h-index:
8
Sinong Wang
Sinong Wang
Citations:
16,371
h-index:
5
Sneha Agarwal
Sneha Agarwal
Citations:
16,395
h-index:
11
Soji Sajuyigbe
Soji Sajuyigbe
Citations:
16,347
h-index:
11
Soumith Chintala
Soumith Chintala
Citations:
124,340
h-index:
32
Stephanie Max
Stephanie Max
Citations:
16,090
h-index:
2
Stephen Chen
Stephen Chen
Citations:
16,279
h-index:
7
Steve Kehoe
Steve Kehoe
Citations:
16,195
h-index:
5
Steve Satterfield
Steve Satterfield
Citations:
16,157
h-index:
4
Sudarshan Govindaprasad
Sudarshan Govindaprasad
Citations:
16,164
h-index:
4
S. Gupta
S. Gupta
Citations:
17,259
h-index:
15
Sung-Bae Cho
Sung-Bae Cho
Citations:
16,179
h-index:
5
Sunny Virk
Sunny Virk
Citations:
16,150
h-index:
3
Suraj Subramanian
Suraj Subramanian
Citations:
16,150
h-index:
3
Sy Choudhury
Sy Choudhury
Citations:
16,664
h-index:
5
Sydney Goldman
Sydney Goldman
Citations:
16,150
h-index:
3
Tal Remez
Tal Remez
Citations:
22,001
h-index:
23
Tamar Glaser
Tamar Glaser
Citations:
16,180
h-index:
6
Tamara Best
Tamara Best
Citations:
16,150
h-index:
3
Thilo Kohler
Thilo Kohler
Citations:
16,133
h-index:
3
Thomas Robinson
Thomas Robinson
Citations:
16,154
h-index:
4
Tianhe Li
Tianhe Li
Citations:
16,732
h-index:
5
Tianjun Zhang
Tianjun Zhang
Citations:
22,129
h-index:
25
Tim Matthews
Tim Matthews
Citations:
16,194
h-index:
5
Timothy Chou
Timothy Chou
Citations:
16,183
h-index:
6
Tzook Shaked
Tzook Shaked
Citations:
16,150
h-index:
3
Varun Vontimitta
Varun Vontimitta
Citations:
16,303
h-index:
4
Victoria O Ajayi
Victoria O Ajayi
Citations:
16,235
h-index:
7
Victoria Montanez
Victoria Montanez
Citations:
16,164
h-index:
4
Vijai Mohan
Vijai Mohan
Citations:
16,150
h-index:
3
Vinay Kumar
Vinay Kumar
Citations:
16,156
h-index:
4
Vishal Mangla
Vishal Mangla
Citations:
16,170
h-index:
4
Vlad Ionescu
Vlad Ionescu
Citations:
19,486
h-index:
7
V. Poenaru
V. Poenaru
Citations:
16,147
h-index:
4
Vlad T. Mihailescu
Vlad T. Mihailescu
Citations:
16,353
h-index:
8
V. Ivanov
V. Ivanov
Citations:
16,170
h-index:
5
Wei Li
Wei Li
Citations:
16,157
h-index:
3
Wenchen Wang
Wenchen Wang
Citations:
16,120
h-index:
4
Gabriel Synnaeve
Gabriel Synnaeve
Citations:
63,500
h-index:
58
Sara Hunt
Sara Hunt
Citations:
16,232
h-index:
5
S. Pan
S. Pan
Citations:
16,732
h-index:
7
Yashesh Gaur
Yashesh Gaur
Citations:
18,226
h-index:
26
Shengxin Zha
Shengxin Zha
Citations:
17,174
h-index:
11
Jeremy Fu
Jeremy Fu
Citations:
33,743
h-index:
10
현대 인공지능(AI) 시스템은 파운데이션 모델(foundation models)에 의해 구동됩니다. 본 논문은 Llama 3라고 불리는 새로운 파운데이션 모델 세트를 제시합니다. 이는 다국어, 코딩, 추론 및 도구 사용을 기본적으로 지원하는 언어 모델군입니다. 가장 큰 모델은 4,050억(405B) 개의 파라미터와 최대 12만 8천(128K) 토큰의 컨텍스트 윈도우를 가진 Dense Transformer입니다. 본 논문은 Llama 3에 대한 광범위한 실증적 평가를 제시합니다. 평가 결과, Llama 3는 수많은 작업에서 GPT-4와 같은 선도적인 언어 모델과 대등한 품질을 제공하는 것으로 나타났습니다. 우리는 4,050억 파라미터 언어 모델의 사전 학습(pre-trained) 및 사후 학습(post-trained) 버전과 입출력 안전을 위한 Llama Guard 3 모델을 포함하여 Llama 3를 공개적으로 배포합니다. 또한 본 논문은 구성적(compositional) 접근 방식을 통해 이미지, 비디오 및 음성 기능을 Llama 3에 통합한 실험 결과를 제시합니다. 우리는 이 접근 방식이 이미지, 비디오 및 음성 인식 작업에서 최신 기술(state-of-the-art)과 경쟁력 있는 성능을 보임을 확인했습니다. 결과물로 나온 모델들은 아직 개발 중이므로 광범위하게 배포되지는 않습니다.
Original
Abstract
Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.
16187
Citations
3031
Influential
29
Altmetric
22,394.0
Score
No Analysis Report Yet
This paper hasn't been analyzed by Gemini yet.
Log in to request an AI analysis.