2303.08774
Mar 15, 2023
cs.AI
GPT-4 기술 보고서
GPT-4 Technical Report
J. Kiros
J. Kiros
Citations:
40,341
h-index:
16
Mark Chen
Mark Chen
Citations:
121,483
h-index:
16
Heewoo Jun
Heewoo Jun
Citations:
45,161
h-index:
15
G. Sastry
G. Sastry
Citations:
132,584
h-index:
16
Scott Gray
Scott Gray
Citations:
109,065
h-index:
13
P. Tillet
P. Tillet
Citations:
39,175
h-index:
8
F. Such
F. Such
Citations:
37,864
h-index:
16
S. Balaji
S. Balaji
Citations:
36,125
h-index:
6
Jan Leike
Jan Leike
Citations:
64,885
h-index:
29
M. Murati
M. Murati
Citations:
34,492
h-index:
6
Bob McGrew
Bob McGrew
Citations:
47,433
h-index:
13
S. Agarwal
S. Agarwal
Citations:
145,226
h-index:
19
L. Ahmad
L. Ahmad
Citations:
26,916
h-index:
13
D. Almeida
D. Almeida
Citations:
22,627
h-index:
5
S. Altman
S. Altman
Citations:
26,474
h-index:
8
Red Avila
Red Avila
Citations:
22,531
h-index:
2
O. Boiko
O. Boiko
Citations:
26,006
h-index:
6
Tim Brooks
Tim Brooks
Citations:
22,624
h-index:
5
Trevor Cai
Trevor Cai
Citations:
22,624
h-index:
5
Che Chang
Che Chang
Citations:
22,664
h-index:
6
Derek Chen
Derek Chen
Citations:
25,220
h-index:
7
Sully Chen
Sully Chen
Citations:
22,587
h-index:
5
Ruby Chen
Ruby Chen
Citations:
25,951
h-index:
6
Jason Chen
Jason Chen
Citations:
22,647
h-index:
6
Casey Chu
Casey Chu
Citations:
25,914
h-index:
4
Arka Dhar
Arka Dhar
Citations:
27,902
h-index:
4
David Dohan
David Dohan
Google Brain
Citations:
45,277
h-index:
24
Atty Eleti
Atty Eleti
Citations:
22,556
h-index:
3
L. Fedus
L. Fedus
Citations:
34,725
h-index:
7
Niko Felix
Niko Felix
Citations:
25,949
h-index:
4
S. Fishman
S. Fishman
Citations:
22,777
h-index:
5
Leo Gao
Leo Gao
EleutherAI
Citations:
36,307
h-index:
16
C. Gibson
C. Gibson
Citations:
25,854
h-index:
4
Vik Goel
Vik Goel
Citations:
22,532
h-index:
2
J. Gordon
J. Gordon
Citations:
22,680
h-index:
4
S. Gu
S. Gu
Citations:
25,112
h-index:
4
Yufei Guo
Yufei Guo
Citations:
22,695
h-index:
5
Jesse Han
Jesse Han
Citations:
22,593
h-index:
3
J. Harris
J. Harris
Citations:
25,918
h-index:
4
Yuchen He
Yuchen He
Citations:
26,116
h-index:
7
W. Hickey
W. Hickey
Citations:
22,705
h-index:
6
Kenny Hsu
Kenny Hsu
Citations:
25,917
h-index:
4
Shengli Hu
Shengli Hu
Citations:
22,620
h-index:
5
Xin Hu
Xin Hu
Citations:
22,756
h-index:
8
Shawn Jain
Shawn Jain
Citations:
22,654
h-index:
2
R. Jiang
R. Jiang
Citations:
22,706
h-index:
6
Denny Jin
Denny Jin
Citations:
26,010
h-index:
7
Ali Kamali
Ali Kamali
Citations:
25,954
h-index:
6
N. Keskar
N. Keskar
Citations:
38,409
h-index:
28
Kyle Kosic
Kyle Kosic
Citations:
22,574
h-index:
2
Vishal Kuo
Vishal Kuo
Citations:
25,992
h-index:
5
Ikai Lan
Ikai Lan
Citations:
25,998
h-index:
5
Teddy Lee
Teddy Lee
Citations:
22,737
h-index:
3
Jade Leung
Jade Leung
Citations:
23,453
h-index:
8
Chak Li
Chak Li
Citations:
25,951
h-index:
4
Rachel Lim
Rachel Lim
Citations:
26,474
h-index:
5
Molly Lin
Molly Lin
Citations:
26,097
h-index:
6
Ryan Lowe
Ryan Lowe
Citations:
22,717
h-index:
5
A. Makanju
A. Makanju
Citations:
22,574
h-index:
2
Luke Metz
Luke Metz
Citations:
26,126
h-index:
5
Tong Mu
Tong Mu
Citations:
22,766
h-index:
4
O. Murk
O. Murk
Citations:
26,091
h-index:
6
R. Ngo
R. Ngo
Citations:
22,659
h-index:
5
A. Paino
A. Paino
Citations:
27,965
h-index:
10
J. Parish
J. Parish
Citations:
25,893
h-index:
5
Vitchyr H. Pong
Vitchyr H. Pong
University of California, Berkeley
Citations:
24,930
h-index:
15
Raul Puri
Raul Puri
Citations:
25,891
h-index:
6
F. Real
F. Real
Citations:
22,572
h-index:
4
Carl Ross
Carl Ross
Citations:
22,640
h-index:
6
N. Ryder
N. Ryder
Citations:
26,276
h-index:
10
S. Shoker
S. Shoker
Citations:
22,791
h-index:
8
M. Simens
M. Simens
Citations:
44,831
h-index:
8
Ian Sohl
Ian Sohl
Citations:
26,061
h-index:
8
Yang Song
Yang Song
Citations:
22,637
h-index:
6
Jie Tang
Jie Tang
Citations:
26,028
h-index:
8
N. Tezak
N. Tezak
Citations:
29,264
h-index:
17
Ben Wang
Ben Wang
Citations:
25,877
h-index:
4
Jason Wei
Jason Wei
Citations:
25,488
h-index:
9
Jiayi Weng
Jiayi Weng
Citations:
25,854
h-index:
4
Sherwin Wu
Sherwin Wu
Citations:
26,039
h-index:
7
Jeff Wu
Jeff Wu
Citations:
23,087
h-index:
7
Michael Wu
Michael Wu
Citations:
25,984
h-index:
7
Kai Xiao
Kai Xiao
Citations:
22,894
h-index:
5
Tao Xu
Tao Xu
Citations:
25,945
h-index:
6
Sarah Yoo
Sarah Yoo
Citations:
22,717
h-index:
6
Kevin Yu
Kevin Yu
Citations:
22,958
h-index:
7
Rowan Zellers
Rowan Zellers
University of Washington
Citations:
25,961
h-index:
7
Alvin Wang
Alvin Wang
Citations:
22,554
h-index:
3
우리는 이미지와 텍스트 입력을 받아 텍스트를 출력할 수 있는 대규모 멀티모달 모델인 GPT-4의 개발에 대해 보고한다. GPT-4는 많은 현실 시나리오에서 인간보다 능력이 부족하지만, 모의 변호사 시험에서 응시자 상위 10% 내외의 점수로 합격하는 등 다양한 전문 및 학술 벤치마크에서 인간 수준의 성능을 보여준다. GPT-4는 문서 내의 다음 토큰을 예측하도록 사전 학습된 트랜스포머 기반 모델이다. 학습 후 정렬(alignment) 과정을 통해 사실성 및 원하는 행동 준수 척도에서의 성능이 향상되었다. 이 프로젝트의 핵심 요소는 광범위한 규모에 걸쳐 예측 가능하게 동작하는 인프라와 최적화 방법을 개발하는 것이었다. 이를 통해 우리는 GPT-4에 사용된 연산량의 1,000분의 1도 안 되는 모델들을 기반으로 GPT-4 성능의 일부 측면을 정확히 예측할 수 있었다.
Original
Abstract
We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.
No Analysis Report Yet
This paper hasn't been analyzed by Gemini yet.