2303.08774
Mar 15, 2023
cs.AI
GPT-4 기술 보고서
GPT-4 Technical Report
J. Kiros
J. Kiros
Citations:
45,064
h-index:
16
Mark Chen
Mark Chen
Citations:
134,179
h-index:
16
Heewoo Jun
Heewoo Jun
Citations:
51,325
h-index:
15
G. Sastry
G. Sastry
Citations:
147,155
h-index:
17
Scott Gray
Scott Gray
Citations:
120,148
h-index:
14
P. Tillet
P. Tillet
Citations:
46,002
h-index:
8
F. Such
F. Such
Citations:
43,526
h-index:
17
S. Balaji
S. Balaji
Citations:
41,440
h-index:
7
Jan Leike
Jan Leike
Citations:
75,001
h-index:
30
M. Murati
M. Murati
Citations:
39,639
h-index:
6
Bob McGrew
Bob McGrew
Citations:
53,197
h-index:
14
S. Agarwal
S. Agarwal
Citations:
162,519
h-index:
20
L. Ahmad
L. Ahmad
Citations:
31,595
h-index:
14
D. Almeida
D. Almeida
Citations:
25,285
h-index:
5
S. Altman
S. Altman
Citations:
31,006
h-index:
8
Red Avila
Red Avila
Citations:
25,177
h-index:
2
O. Boiko
O. Boiko
Citations:
30,109
h-index:
7
Tim Brooks
Tim Brooks
Citations:
25,297
h-index:
7
Trevor Cai
Trevor Cai
Citations:
25,297
h-index:
7
Che Chang
Che Chang
Citations:
25,343
h-index:
8
Derek Chen
Derek Chen
Citations:
28,532
h-index:
8
Sully Chen
Sully Chen
Citations:
25,247
h-index:
5
Ruby Chen
Ruby Chen
Citations:
29,642
h-index:
8
Jason Chen
Jason Chen
Citations:
25,323
h-index:
7
Casey Chu
Casey Chu
Citations:
29,584
h-index:
4
Arka Dhar
Arka Dhar
Citations:
32,778
h-index:
6
David Dohan
David Dohan
Google Brain
Citations:
50,029
h-index:
24
Atty Eleti
Atty Eleti
Citations:
25,204
h-index:
3
L. Fedus
L. Fedus
Citations:
38,873
h-index:
8
N. Felix
N. Felix
Citations:
30,027
h-index:
4
S. Fishman
S. Fishman
Citations:
25,888
h-index:
5
Leo Gao
Leo Gao
EleutherAI
Citations:
40,050
h-index:
17
C. Gibson
C. Gibson
Citations:
29,512
h-index:
4
Vik Goel
Vik Goel
Citations:
25,180
h-index:
3
J. Gordon
J. Gordon
Citations:
25,755
h-index:
4
S. Gu
S. Gu
Citations:
28,048
h-index:
4
Yufei Guo
Yufei Guo
Citations:
25,399
h-index:
6
Jesse Han
Jesse Han
Citations:
25,252
h-index:
3
J. Harris
J. Harris
Citations:
29,587
h-index:
5
Yuchen He
Yuchen He
Citations:
29,797
h-index:
8
W. Hickey
W. Hickey
Citations:
25,390
h-index:
8
Kenny Hsu
Kenny Hsu
Citations:
29,603
h-index:
6
Shengli Hu
Shengli Hu
Citations:
25,283
h-index:
6
Xin Hu
Xin Hu
Citations:
25,455
h-index:
9
Shawn Jain
Shawn Jain
Citations:
25,316
h-index:
2
R. Jiang
R. Jiang
Citations:
25,391
h-index:
8
Denny Jin
Denny Jin
Citations:
29,711
h-index:
8
Ali Kamali
Ali Kamali
Citations:
29,638
h-index:
6
N. Keskar
N. Keskar
Citations:
43,042
h-index:
28
Kyle Kosic
Kyle Kosic
Citations:
25,226
h-index:
2
Vishal Kuo
Vishal Kuo
Citations:
30,075
h-index:
5
Ikai Lan
Ikai Lan
Citations:
30,087
h-index:
5
Teddy Lee
Teddy Lee
Citations:
25,429
h-index:
3
Jade Leung
Jade Leung
Citations:
26,175
h-index:
8
Chak Li
Chak Li
Citations:
30,030
h-index:
4
Rachel Lim
Rachel Lim
Citations:
30,168
h-index:
5
Molly Lin
Molly Lin
Citations:
30,207
h-index:
6
Ryan Lowe
Ryan Lowe
Citations:
25,379
h-index:
5
A. Makanju
A. Makanju
Citations:
25,226
h-index:
2
Luke Metz
Luke Metz
Citations:
29,789
h-index:
6
Tong Mu
Tong Mu
Citations:
25,420
h-index:
4
O. Murk
O. Murk
Citations:
30,190
h-index:
6
R. Ngo
R. Ngo
Citations:
25,324
h-index:
5
A. Paino
A. Paino
Citations:
32,157
h-index:
10
J. Parish
J. Parish
Citations:
29,551
h-index:
5
Vitchyr H. Pong
Vitchyr H. Pong
University of California, Berkeley
Citations:
28,056
h-index:
15
Raul Puri
Raul Puri
Citations:
29,573
h-index:
6
F. Real
F. Real
Citations:
25,211
h-index:
4
Carl Ross
Carl Ross
Citations:
25,316
h-index:
7
N. Ryder
N. Ryder
Citations:
30,055
h-index:
11
S. Shoker
S. Shoker
Citations:
25,486
h-index:
9
M. Simens
M. Simens
Citations:
51,309
h-index:
9
Ian Sohl
Ian Sohl
Citations:
30,172
h-index:
8
Yang Song
Yang Song
Citations:
25,311
h-index:
7
Jie Tang
Jie Tang
Citations:
30,143
h-index:
8
N. Tezak
N. Tezak
Citations:
33,089
h-index:
18
Ben Wang
Ben Wang
Citations:
29,544
h-index:
5
Jason Wei
Jason Wei
Citations:
28,434
h-index:
10
Jiayi Weng
Jiayi Weng
Citations:
29,506
h-index:
4
Sherwin Wu
Sherwin Wu
Citations:
30,139
h-index:
8
Jeff Wu
Jeff Wu
Citations:
25,838
h-index:
8
Michael Wu
Michael Wu
Citations:
29,664
h-index:
8
Kai Xiao
Kai Xiao
Citations:
25,696
h-index:
5
Tao Xu
Tao Xu
Citations:
29,625
h-index:
8
Sarah Yoo
Sarah Yoo
Citations:
25,807
h-index:
7
Kevin Yu
Kevin Yu
Citations:
26,077
h-index:
8
Rowan Zellers
Rowan Zellers
University of Washington
Citations:
29,641
h-index:
8
Alvin Wang
Alvin Wang
Citations:
25,196
h-index:
3
O. Long
O. Long
Citations:
32,147
h-index:
11
우리는 이미지와 텍스트 입력을 받아 텍스트를 출력할 수 있는 대규모 멀티모달 모델인 GPT-4의 개발에 대해 보고한다. GPT-4는 많은 현실 시나리오에서 인간보다 능력이 부족하지만, 모의 변호사 시험에서 응시자 상위 10% 내외의 점수로 합격하는 등 다양한 전문 및 학술 벤치마크에서 인간 수준의 성능을 보여준다. GPT-4는 문서 내의 다음 토큰을 예측하도록 사전 학습된 트랜스포머 기반 모델이다. 학습 후 정렬(alignment) 과정을 통해 사실성 및 원하는 행동 준수 척도에서의 성능이 향상되었다. 이 프로젝트의 핵심 요소는 광범위한 규모에 걸쳐 예측 가능하게 동작하는 인프라와 최적화 방법을 개발하는 것이었다. 이를 통해 우리는 GPT-4에 사용된 연산량의 1,000분의 1도 안 되는 모델들을 기반으로 GPT-4 성능의 일부 측면을 정확히 예측할 수 있었다.
Original
Abstract
We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.
Original PDF
{ copied = true; setTimeout(() => copied = false, 2000); })"
class="btn btn-square btn-sm btn-ghost text-base-content/50 hover:text-primary hover:bg-base-200 transition-colors mb-1"
:class="{ 'tooltip tooltip-success': copied, 'tooltip': !copied }"
:data-tip="copied ? '복사 완료!' : 'PDF 링크 복사'">
Copy PDF Link
No Analysis Report Yet
This paper hasn't been analyzed by Gemini yet.
Log in to request an AI analysis.