2602.10604v2 Feb 11, 2026 cs.CL

Step 3.5 Flash: 110억 개의 활성 파라미터를 갖춘 최첨단 수준의 지능

Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters

Yongchi Zhao

Citations: 190

h-index: 3

Luck Ma

Citations: 0

h-index: 0

Fanqi Wan

Citations: 11

h-index: 2

Mengqiang Ren

Citations: 10

h-index: 1

Zhewei Huang

Citations: 46

h-index: 3

Guopeng Li

Citations: 280

h-index: 4

Zheng Ge

Citations: 383

h-index: 10

R. Han

Citations: 320

h-index: 8

Yongyao Wang

Citations: 8

h-index: 2

Haonan Jia

Citations: 6

h-index: 1

Yin Zhao

Citations: 65

h-index: 3

Heng Wang

Citations: 209

h-index: 5

Xin Li

Citations: 97

h-index: 5

Jiaran Zhang

Citations: 43

h-index: 3

Di Qi

Citations: 56

h-index: 3

Xuefeng Zhao

Citations: 46

h-index: 3

Liangyu Chen

Citations: 257

h-index: 5

Zhengwen Zeng

Citations: 93

h-index: 3

Jingwei Wu

Citations: 294

h-index: 5

Yanlin Lai

Citations: 17

h-index: 2

Hong Peng

Citations: 6

h-index: 1

Xiangyu Zhang

Citations: 520

h-index: 6

Wen-Yu Deng

Citations: 119

h-index: 3

Chen Hu

Citations: 217

h-index: 6

Daxin Jiang

Citations: 51

h-index: 4

Xiangfeng Wang

Citations: 18

h-index: 2

Shanyi Wang

Citations: 35

h-index: 2

Ang Li

Citations: 233

h-index: 5

Chengyuan Yao

Citations: 118

h-index: 4

Zhe Xie

Citations: 296

h-index: 10

Ailin Huang

Megvii Research

Citations: 302

h-index: 7

Aobo Kong

Citations: 12

h-index: 2

Bin Wang

Citations: 272

h-index: 5

Binxing Jiao

Citations: 2,645

h-index: 19

Bo Dong

Citations: 155

h-index: 2

Bo Wang

Citations: 107

h-index: 3

Boyu Chen

Citations: 104

h-index: 3

Brian Li

Citations: 296

h-index: 5

Buyun Ma

Citations: 221

h-index: 6

Chang Su

Citations: 1

h-index: 1

Changxing Miao

Citations: 334

h-index: 6

Changyi Wan

Citations: 384

h-index: 7

Chao Lou

Citations: 8

h-index: 2

Chen Xu

Citations: 212

h-index: 6

Chenfeng Yu

Citations: 5

h-index: 2

Chengting Feng

Citations: 80

h-index: 1

Chunrui Han

Citations: 1,639

h-index: 16

Dandan Ma

Citations: 9

h-index: 2

Da Shi

Citations: 306

h-index: 5

Dehua Ma

Citations: 23

h-index: 1

Enle Liu

Citations: 301

h-index: 5

Fajie Zhang

Citations: 34

h-index: 1

Guanzhe Huang

Citations: 326

h-index: 6

Gulin Yan

Citations: 301

h-index: 5

Guoliang Cao

Citations: 14

h-index: 2

Han Cheng

Citations: 12

h-index: 2

Hangyu Guo

Citations: 6

h-index: 1

Hanshan Zhang

Citations: 125

h-index: 6

Hao Nie

Citations: 75

h-index: 4

Haoran Lv

Citations: 157

h-index: 5

Hebin Zhou

Citations: 43

h-index: 3

He Lv

Citations: 26

h-index: 3

H. Shum

Citations: 8,048

h-index: 34

Hongbo Huang

Citations: 62

h-index: 4

Hongyu Zhou

Citations: 224

h-index: 5

Hongyuan Wang

Citations: 111

h-index: 4

Hou-Tong Chen

Citations: 84

h-index: 3

Huan Zhu

Citations: 4

h-index: 1

Huimin Wu

Citations: 19

h-index: 3

H. Guo

Citations: 4

h-index: 1

Jia Wang

Citations: 1

h-index: 1

Jian Zhou

Citations: 35

h-index: 1

Jia-Nan Sun

Citations: 1

h-index: 1

J. Wu

Citations: 304

h-index: 5

Jiashu Lv

Citations: 23

h-index: 2

Jiashuo Liu

Citations: 97

h-index: 1

Jiaying Fu

Citations: 6

h-index: 1

Jiayu Liu

Citations: 36

h-index: 1

Jie Cheng

Citations: 14

h-index: 2

Jie Luo

Citations: 5

h-index: 1

Jie Yang

Citations: 109

h-index: 6

Jie Zhou

Citations: 3

h-index: 1

Jing Bai

Citations: 107

h-index: 2

Jingcheng Hu

Citations: 90

h-index: 5

Jin Xie

Citations: 216

h-index: 4

Jingyang Zhang

Citations: 11

h-index: 1

Jishi Zhou

Citations: 0

h-index: 0

Junfeng Liu

Citations: 55

h-index: 3

Junzhe Lin

Citations: 308

h-index: 5

Ka Man Lo

Citations: 64

h-index: 3

Kaiqu Liang

Citations: 347

h-index: 3

Kaibo Liu

Citations: 102

h-index: 4

Kaijun Tan

Citations: 246

h-index: 6

Kaiwen Yan

Citations: 49

h-index: 3

Kai-yang Li

Citations: 207

h-index: 6

Kang An

Citations: 193

h-index: 5

Kangheng Lin

Citations: 196

h-index: 7

Lei Yang

Citations: 4

h-index: 1

Liang Lv

Citations: 0

h-index: 0

Liang Zhao

Citations: 275

h-index: 9

Lieyu Shi

Citations: 44

h-index: 2

Liguo Tan

Citations: 137

h-index: 2

Lin Lin

Citations: 79

h-index: 5

Lina Chen

Citations: 35

h-index: 1

Michael Li

Citations: 136

h-index: 4

Ming Li

Citations: 58

h-index: 4

Mingliang Li

Citations: 323

h-index: 6

Mingming Zhang

Citations: 4

h-index: 1

Mingrui Chen

Citations: 321

h-index: 7

Mitt Huang

Citations: 6

h-index: 1

Na Wang

Citations: 309

h-index: 5

Peng Liu

Citations: 153

h-index: 4

QiuYing Han

Citations: 0

h-index: 0

Qian Zhao

Citations: 7

h-index: 1

Qi He

Citations: 256

h-index: 2

Q. Du

Citations: 5

h-index: 1

Qiuping Wu

Citations: 41

h-index: 2

Quan Sun

Citations: 0

h-index: 0

Rong Yang

Citations: 1,387

h-index: 12

Ruihang Miao

Citations: 420

h-index: 9

Ruosi Wan

Citations: 281

h-index: 10

Ruyan Guo

Citations: 36

h-index: 2

Shaoliang Pang

Citations: 307

h-index: 6

Shaowen Yang

Citations: 47

h-index: 2

S. Fan

Citations: 120

h-index: 5

Shijie Shang

Citations: 12

h-index: 1

S. Yang

Citations: 69

h-index: 3

Shiwei Li

Citations: 12

h-index: 2

Shuangshuang Tian

Citations: 19

h-index: 1

Siqi Liu

Citations: 308

h-index: 6

Siye Wu

Citations: 259

h-index: 3

Siyu Chen

Citations: 108

h-index: 4

Song Yuan

Citations: 13

h-index: 2

Tiancheng Cao

Citations: 302

h-index: 5

Tianchi Yue

Citations: 5

h-index: 1

Tianhao Cheng

Citations: 412

h-index: 6

Tian-You Li

Citations: 1

h-index: 1

Wang You

Citations: 194

h-index: 5

Wei Ji

Citations: 5

h-index: 1

Wei Yuan

Citations: 39

h-index: 4

Wei Zhang

Citations: 88

h-index: 1

Weibo Wu

Citations: 18

h-index: 2

Wei-Bing Xie

Citations: 17

h-index: 2

Wenzhe Sun

Citations: 121

h-index: 6

W. Zheng

Citations: 3

h-index: 1

Wuxun Xie

Citations: 177

h-index: 4

Xian-chang Kong

Citations: 0

h-index: 0

Xiangyu Liu

Citations: 7

h-index: 2

Xiaobo Yang

Citations: 44

h-index: 3

Xiao‐Jun Liu

Citations: 7

h-index: 2

Xiao-Peng Yuan

Citations: 0

h-index: 0

Xiao-fei Jiao

Citations: 7

h-index: 1

Xiao-Yong Ren

Citations: 6

h-index: 1

Xiaoyun Zhang

Citations: 25

h-index: 2

Xin Wu

Citations: 14

h-index: 3

Xing Chen

Citations: 185

h-index: 4

Xingping Yang

Citations: 34

h-index: 1

Xinran Wang

Citations: 1

h-index: 1

Xuan He

Citations: 63

h-index: 4

Xu Feng

Citations: 11

h-index: 1

Xuedan Cai

Citations: 29

h-index: 2

Xuqiang Zhou

Citations: 0

h-index: 0

Yanbo Yu

Citations: 308

h-index: 6

Yang Li

Citations: 54

h-index: 4

Yang Xu

Citations: 40

h-index: 2

Yanming Xu

Citations: 271

h-index: 5

Yaoyu Wang

Citations: 114

h-index: 2

Yeqing Shen

Citations: 52

h-index: 3

Yibo Zhu

Citations: 416

h-index: 7

Yichen Lv

Citations: 7

h-index: 1

Yicheng Cao

Citations: 5

h-index: 1

Yifeng Gong

Citations: 47

h-index: 3

Yijing Yang

Citations: 57

h-index: 4

Yikun Yang

Citations: 44

h-index: 3

Yinmin Zhang

Citations: 429

h-index: 5

Yitong Zhang

Citations: 2

h-index: 1

Yixuan Zhang

Citations: 0

h-index: 0

Yiyang Chen

Citations: 0

h-index: 0

Yongshen Long

Citations: 9

h-index: 1

Yu Zhou

Citations: 345

h-index: 6

Yuang Peng

Tsinghua University

Citations: 1,086

h-index: 11

Yu-Lai Ding

Citations: 4

h-index: 1

Yu-Jin Fan

Citations: 0

h-index: 0

Yuanzhen Yang

Citations: 95

h-index: 3

Yu-Lan Luo

Citations: 6

h-index: 1

Yudi Zhao

Citations: 67

h-index: 5

Yue Peng

Citations: 93

h-index: 6

Yueqiang Lin

Citations: 5

h-index: 2

Yu-ting Lu

Citations: 98

h-index: 3

Yulin Zhao

Citations: 13

h-index: 3

Yunzhou Ju

Citations: 34

h-index: 1

Yurong Zhang

Citations: 6

h-index: 1

Yusheng Li

Citations: 3

h-index: 1

Yuxiang Yang

Citations: 436

h-index: 6

Yuyang Chen

Citations: 105

h-index: 5

Yuzhuo Cai

Citations: 91

h-index: 4

Zejia Weng

Citations: 66

h-index: 4

Zetao Hong

Citations: 1

h-index: 1

Zexi Li

Citations: 21

h-index: 2

Zheng Gong

Citations: 126

h-index: 4

Zhenyi Lu

Citations: 16

h-index: 3

Zhichao Chang

Citations: 119

h-index: 3

Zhiguo Huang

Citations: 14

h-index: 2

Zhi-Hang Hu

Citations: 0

h-index: 0

Zi-Kang Yang

Citations: 0

h-index: 0

Zili Wang

Citations: 80

h-index: 4

Ziqi Ren

Citations: 23

h-index: 3

Zixin Zhang

Citations: 35

h-index: 2

Zixuan Wang

Citations: 5

h-index: 1

Deshan Sun

Citations: 291

h-index: 5

Xin Liu

Citations: 97

h-index: 3

Y. Guan

Citations: 14

h-index: 3

Jie Hou

Citations: 187

h-index: 9

Tingdan Luo

Citations: 153

h-index: 3

본 논문에서는 Step 3.5 Flash를 소개합니다. 이는 최첨단 수준의 에이전트 지능과 계산 효율성을 결합한 희소한 Mixture-of-Experts (MoE) 모델입니다. 에이전트 구축 시 가장 중요한 요소인 정확한 추론 능력과 빠르고 안정적인 실행 능력을 중심으로 설계되었습니다. Step 3.5 Flash는 1960억 개의 파라미터로 구성된 기반 모델과 110억 개의 활성 파라미터를 사용하여 효율적인 추론을 가능하게 합니다. 또한, 다중 라운드 에이전트 상호 작용의 지연 시간과 비용을 줄이기 위해 3:1의 인터리브된 슬라이딩 윈도우/전체 어텐션 및 Multi-Token Prediction (MTP-3) 기술이 적용되었습니다. 최첨단 수준의 지능을 달성하기 위해, 검증 가능한 신호와 선호도 피드백을 결합한 확장 가능한 강화 학습 프레임워크를 설계했습니다. 이 프레임워크는 대규모 오프라인 학습 환경에서도 안정성을 유지하며, 수학, 코딩 및 도구 사용 능력 전반에 걸쳐 일관된 자기 개선을 가능하게 합니다. Step 3.5 Flash는 에이전트, 코딩 및 수학 관련 작업에서 뛰어난 성능을 보여주며, IMO-AnswerBench에서 85.4%, LiveCodeBench-v6 (2024.08-2025.05)에서 86.4%, tau2-Bench에서 88.2%, BrowseComp (컨텍스트 관리 포함)에서 69.0%, Terminal-Bench 2.0에서 51.0%의 정확도를 달성했습니다. 이는 GPT-5.2 xHigh 및 Gemini 3.0 Pro와 같은 최첨단 모델과 비교 가능한 수준입니다. Step 3.5 Flash는 효율성의 한계를 재정의함으로써, 실제 산업 환경에서 정교한 에이전트를 배포하기 위한 고밀도의 기반 모델을 제공합니다.

Original Abstract

We introduce Step 3.5 Flash, a sparse Mixture-of-Experts (MoE) model that bridges frontier-level agentic intelligence and computational efficiency. We focus on what matters most when building agents: sharp reasoning and fast, reliable execution. Step 3.5 Flash pairs a 196B-parameter foundation with 11B active parameters for efficient inference. It is optimized with interleaved 3:1 sliding-window/full attention and Multi-Token Prediction (MTP-3) to reduce the latency and cost of multi-round agentic interactions. To reach frontier-level intelligence, we design a scalable reinforcement learning framework that combines verifiable signals with preference feedback, while remaining stable under large-scale off-policy training, enabling consistent self-improvement across mathematics, code, and tool use. Step 3.5 Flash demonstrates strong performance across agent, coding, and math tasks, achieving 85.4% on IMO-AnswerBench, 86.4% on LiveCodeBench-v6 (2024.08-2025.05), 88.2% on tau2-Bench, 69.0% on BrowseComp (with context management), and 51.0% on Terminal-Bench 2.0, comparable to frontier models such as GPT-5.2 xHigh and Gemini 3.0 Pro. By redefining the efficiency frontier, Step 3.5 Flash provides a high-density foundation for deploying sophisticated agents in real-world industrial environments.

1 Citations

0 Influential

17 Altmetric

86.0 Score

Original PDF

No Analysis Report Yet

This paper hasn't been analyzed by Gemini yet.

댓글을 작성하려면 로그인하세요.

아직 댓글이 없습니다. 첫 번째 댓글을 남겨보세요!