2303.08774
Mar 15, 2023
cs.AI
GPT-4 기술 보고서
GPT-4 Technical Report
J. Kiros
J. Kiros
Citations:
42,709
h-index:
16
Mark Chen
Mark Chen
Citations:
127,554
h-index:
16
Heewoo Jun
Heewoo Jun
Citations:
47,936
h-index:
15
G. Sastry
G. Sastry
Citations:
139,807
h-index:
16
Scott Gray
Scott Gray
Citations:
114,483
h-index:
14
P. Tillet
P. Tillet
Citations:
42,593
h-index:
8
F. Such
F. Such
Citations:
40,640
h-index:
16
S. Balaji
S. Balaji
Citations:
38,771
h-index:
7
Jan Leike
Jan Leike
Citations:
69,530
h-index:
30
M. Murati
M. Murati
Citations:
37,055
h-index:
6
Bob McGrew
Bob McGrew
Citations:
50,274
h-index:
14
S. Agarwal
S. Agarwal
Citations:
153,768
h-index:
20
L. Ahmad
L. Ahmad
Citations:
29,278
h-index:
14
D. Almeida
D. Almeida
Citations:
23,986
h-index:
5
S. Altman
S. Altman
Citations:
28,754
h-index:
8
Red Avila
Red Avila
Citations:
23,886
h-index:
2
O. Boiko
O. Boiko
Citations:
28,103
h-index:
7
Tim Brooks
Tim Brooks
Citations:
23,997
h-index:
7
Trevor Cai
Trevor Cai
Citations:
23,997
h-index:
7
Che Chang
Che Chang
Citations:
24,042
h-index:
8
Derek Chen
Derek Chen
Citations:
26,857
h-index:
8
Sully Chen
Sully Chen
Citations:
23,951
h-index:
5
Ruby Chen
Ruby Chen
Citations:
27,889
h-index:
8
Jason Chen
Jason Chen
Citations:
24,023
h-index:
7
Casey Chu
Casey Chu
Citations:
27,834
h-index:
4
Arka Dhar
Arka Dhar
Citations:
30,466
h-index:
5
David Dohan
David Dohan
Google Brain
Citations:
47,526
h-index:
24
Atty Eleti
Atty Eleti
Citations:
23,911
h-index:
3
L. Fedus
L. Fedus
Citations:
36,875
h-index:
8
Niko Felix
Niko Felix
Citations:
28,028
h-index:
4
S. Fishman
S. Fishman
Citations:
24,315
h-index:
5
Leo Gao
Leo Gao
EleutherAI
Citations:
38,117
h-index:
16
C. Gibson
C. Gibson
Citations:
27,768
h-index:
4
Vik Goel
Vik Goel
Citations:
23,887
h-index:
2
J. Gordon
J. Gordon
Citations:
24,206
h-index:
4
S. Gu
S. Gu
Citations:
26,601
h-index:
4
Yufei Guo
Yufei Guo
Citations:
24,075
h-index:
5
Jesse Han
Jesse Han
Citations:
23,954
h-index:
3
J. Harris
J. Harris
Citations:
27,838
h-index:
5
Yuchen He
Yuchen He
Citations:
28,039
h-index:
8
W. Hickey
W. Hickey
Citations:
24,085
h-index:
8
Kenny Hsu
Kenny Hsu
Citations:
27,854
h-index:
6
Shengli Hu
Shengli Hu
Citations:
23,984
h-index:
6
Xin Hu
Xin Hu
Citations:
24,142
h-index:
9
Shawn Jain
Shawn Jain
Citations:
24,012
h-index:
2
R. Jiang
R. Jiang
Citations:
24,086
h-index:
8
Denny Jin
Denny Jin
Citations:
27,953
h-index:
8
Ali Kamali
Ali Kamali
Citations:
27,880
h-index:
6
N. Keskar
N. Keskar
Citations:
40,736
h-index:
28
Kyle Kosic
Kyle Kosic
Citations:
23,931
h-index:
2
Vishal Kuo
Vishal Kuo
Citations:
28,075
h-index:
5
Ikai Lan
Ikai Lan
Citations:
28,085
h-index:
5
Teddy Lee
Teddy Lee
Citations:
24,112
h-index:
3
Jade Leung
Jade Leung
Citations:
24,837
h-index:
8
Chak Li
Chak Li
Citations:
28,032
h-index:
4
Rachel Lim
Rachel Lim
Citations:
28,407
h-index:
5
Molly Lin
Molly Lin
Citations:
28,197
h-index:
6
Ryan Lowe
Ryan Lowe
Citations:
24,079
h-index:
5
A. Makanju
A. Makanju
Citations:
23,931
h-index:
2
Luke Metz
Luke Metz
Citations:
28,046
h-index:
6
Tong Mu
Tong Mu
Citations:
24,127
h-index:
4
O. Murk
O. Murk
Citations:
28,183
h-index:
6
R. Ngo
R. Ngo
Citations:
24,020
h-index:
5
A. Paino
A. Paino
Citations:
30,115
h-index:
10
J. Parish
J. Parish
Citations:
27,808
h-index:
5
Vitchyr H. Pong
Vitchyr H. Pong
University of California, Berkeley
Citations:
26,475
h-index:
15
Raul Puri
Raul Puri
Citations:
27,819
h-index:
6
F. Real
F. Real
Citations:
23,933
h-index:
5
Carl Ross
Carl Ross
Citations:
24,016
h-index:
7
N. Ryder
N. Ryder
Citations:
28,245
h-index:
11
S. Shoker
S. Shoker
Citations:
24,174
h-index:
9
M. Simens
M. Simens
Citations:
48,004
h-index:
9
Ian Sohl
Ian Sohl
Citations:
28,165
h-index:
8
Yang Song
Yang Song
Citations:
24,011
h-index:
7
Jie Tang
Jie Tang
Citations:
28,116
h-index:
8
N. Tezak
N. Tezak
Citations:
31,250
h-index:
17
Ben Wang
Ben Wang
Citations:
27,797
h-index:
5
Jason Wei
Jason Wei
Citations:
26,981
h-index:
10
Jiayi Weng
Jiayi Weng
Citations:
27,764
h-index:
4
Sherwin Wu
Sherwin Wu
Citations:
28,135
h-index:
8
Jeff Wu
Jeff Wu
Citations:
24,483
h-index:
8
Michael Wu
Michael Wu
Citations:
27,920
h-index:
8
Kai Xiao
Kai Xiao
Citations:
24,308
h-index:
5
Tao Xu
Tao Xu
Citations:
27,874
h-index:
8
Sarah Yoo
Sarah Yoo
Citations:
24,254
h-index:
7
Kevin Yu
Kevin Yu
Citations:
24,510
h-index:
8
Rowan Zellers
Rowan Zellers
University of Washington
Citations:
27,891
h-index:
8
Alvin Wang
Alvin Wang
Citations:
23,905
h-index:
3
우리는 이미지와 텍스트 입력을 받아 텍스트를 출력할 수 있는 대규모 멀티모달 모델인 GPT-4의 개발에 대해 보고한다. GPT-4는 많은 현실 시나리오에서 인간보다 능력이 부족하지만, 모의 변호사 시험에서 응시자 상위 10% 내외의 점수로 합격하는 등 다양한 전문 및 학술 벤치마크에서 인간 수준의 성능을 보여준다. GPT-4는 문서 내의 다음 토큰을 예측하도록 사전 학습된 트랜스포머 기반 모델이다. 학습 후 정렬(alignment) 과정을 통해 사실성 및 원하는 행동 준수 척도에서의 성능이 향상되었다. 이 프로젝트의 핵심 요소는 광범위한 규모에 걸쳐 예측 가능하게 동작하는 인프라와 최적화 방법을 개발하는 것이었다. 이를 통해 우리는 GPT-4에 사용된 연산량의 1,000분의 1도 안 되는 모델들을 기반으로 GPT-4 성능의 일부 측면을 정확히 예측할 수 있었다.
Original
Abstract
We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.
Original PDF
{ copied = true; setTimeout(() => copied = false, 2000); })"
class="btn btn-square btn-sm btn-ghost text-base-content/50 hover:text-primary hover:bg-base-200 transition-colors mb-1"
:class="{ 'tooltip tooltip-success': copied, 'tooltip': !copied }"
:data-tip="copied ? '복사 완료!' : 'PDF 링크 복사'">
Copy PDF Link
No Analysis Report Yet
This paper hasn't been analyzed by Gemini yet.
Log in to request an AI analysis.