ERNIE 5.0 Technical Report
In this report, we introduce ERNIE 5.0, a natively autoregressive foundation model desinged for unified multimodal understanding and generation across text, image, video, and audio. All modalities are trained from scratch under a unified next-group-of-tokens prediction objective, based on an ultra-sparse mixture-of-experts (MoE) architecture with modality-agnostic expert routing. To address practical challenges in large-scale deployment under diverse resource constraints, ERNIE 5.0 adopts a novel elastic training paradigm. Within a single pre-training run, the model learns a family of sub-models with varying depths, expert capacities, and routing sparsity, enabling flexible trade-offs among performance, model size, and inference latency in memory- or time-constrained scenarios. Moreover, we systematically address the challenges of scaling reinforcement learning to unified foundation models, thereby guaranteeing efficient and stable post-training under ultra-sparse MoE architectures and diverse multimodal settings. Extensive experiments demonstrate that ERNIE 5.0 achieves strong and balanced performance across multiple modalities. To the best of our knowledge, among publicly disclosed models, ERNIE 5.0 represents the first production-scale realization of a trillion-parameter unified autoregressive model that supports both multimodal understanding and generation. To facilitate further research, we present detailed visualizations of modality-agnostic expert routing in the unified model, alongside comprehensive empirical analysis of elastic training, aiming to offer profound insights to the community.
698424a7e34659da7e1f4e6f
Haifeng Wang
698424a7e34659da7e1f4e70
Hua Wu
698424a7e34659da7e1f4e71
Tian Wu
698424a7e34659da7e1f4e72
Yu Sun
698424a7e34659da7e1f4e73
Jing Liu
698424a7e34659da7e1f4e74
Dianhai Yu
698424a7e34659da7e1f4e75
Yanjun Ma
698424a7e34659da7e1f4e76
Jingzhou He
698424a7e34659da7e1f4e77
Zhongjun He
698424a7e34659da7e1f4e78
Dou Hong
698424a7e34659da7e1f4e79
Qiwen Liu
698424a7e34659da7e1f4e7a
Shuohuan Wang
698424a7e34659da7e1f4e7b
Junyuan Shang
claimed_verified
2026-02-05T10:53:28.482Z
62cd9632342b1d5dab8df4c3
/avatars/9080d20bb57a05a1eeb6800eba886cf9.svg
Junyuan Shang
sjy1203
user
sjy1203
698424a7e34659da7e1f4e7c
Zhenyu Zhang
claimed_verified
2026-02-05T10:53:03.972Z
67f37f78b36e82d366dedeec
/avatars/678bb5891d5c2e80edc0799d2308a5d3.svg
Max Zhenyu Zhang
max-zhenyu-zhang
user
max-zhenyu-zhang
698424a7e34659da7e1f4e7d
Yuchen Ding
698424a7e34659da7e1f4e7e
Jinle Zeng
698424a7e34659da7e1f4e7f
Jiabin Yang
698424a7e34659da7e1f4e80
Liang Shen
698424a7e34659da7e1f4e81
Ruibiao Chen
698424a7e34659da7e1f4e82
Weichong Yin
698424a7e34659da7e1f4e83
Siyu Ding
698424a7e34659da7e1f4e84
Dai Dai
698424a7e34659da7e1f4e85
Shikun Feng
698424a7e34659da7e1f4e86
Siqi Bao
698424a7e34659da7e1f4e87
Bolei He
claimed_verified
2026-02-06T18:53:26.749Z
68aefd6482a3030535876c27
/avatars/8df724044e3087eea3628a8927b4da69.svg
HeBolei
HeBolei
user
HeBolei
698424a7e34659da7e1f4e88
Yan Chen
698424a7e34659da7e1f4e89
Zhenyu Jiao
698424a7e34659da7e1f4e8a
Ruiqing Zhang
698424a7e34659da7e1f4e8b
Zeyu Chen
claimed_verified
2026-02-06T18:53:17.655Z
5f3ff69679c1ba4c353d0c5a
https://cdn-avatars.huggingface.co/v1/production/uploads/1644815656114-5f3ff69679c1ba4c353d0c5a.jpeg
Zeyu Chen
Zeyu
user
Zeyu
698424a7e34659da7e1f4e8c
Qingqing Dang
698424a7e34659da7e1f4e8d
Kaipeng Deng
698424a7e34659da7e1f4e8e
Jiajun Jiang
698424a7e34659da7e1f4e8f
Enlei Gong
698424a7e34659da7e1f4e90
Guoxia Wang
698424a7e34659da7e1f4e91
Yanlin Sha
698424a7e34659da7e1f4e92
Yi Liu
claimed_verified
2026-02-27T16:45:46.996Z
6501403fea5699b59abacf15
https://cdn-avatars.huggingface.co/v1/production/uploads/6501403fea5699b59abacf15/Sh9ouC68HWHsF1Jh_0CGi.jpeg
Yi Liu
michaelowenliu
user
michaelowenliu
698424a7e34659da7e1f4e93
Yehan Zheng
698424a7e34659da7e1f4e94
Weijian Xu
698424a7e34659da7e1f4e95
Jiaxiang Liu
698424a7e34659da7e1f4e96
Zengfeng Zeng
698424a7e34659da7e1f4e97
Yingqi Qu
698424a7e34659da7e1f4e98
Zhongli Li
698424a7e34659da7e1f4e99
Zhengkun Zhang
698424a7e34659da7e1f4e9a
Xiyang Wang
698424a7e34659da7e1f4e9b
Zixiang Xu
698424a7e34659da7e1f4e9c
Xinchao Xu
698424a7e34659da7e1f4e9d
Zhengjie Huang
698424a7e34659da7e1f4e9e
Dong Wang
698424a7e34659da7e1f4e9f
Bingjin Chen
698424a7e34659da7e1f4ea0
Yue Chang
698424a7e34659da7e1f4ea1
Xing Yuan
698424a7e34659da7e1f4ea2
Shiwei Huang
698424a7e34659da7e1f4ea3
Qiao Zhao
698424a7e34659da7e1f4ea4
Xinzhe Ding
698424a7e34659da7e1f4ea5
Shuangshuang Qiao
698424a7e34659da7e1f4ea6
Baoshan Yang
698424a7e34659da7e1f4ea7
Bihong Tang
698424a7e34659da7e1f4ea8
Bin Li
698424a7e34659da7e1f4ea9
Bingquan Wang
698424a7e34659da7e1f4eaa
Binhan Tang
698424a7e34659da7e1f4eab
Binxiong Zheng
698424a7e34659da7e1f4eac
Bo Cui
698424a7e34659da7e1f4ead
Bo Ke
698424a7e34659da7e1f4eae
Bo Zhang
698424a7e34659da7e1f4eaf
Bowen Zhang
698424a7e34659da7e1f4eb0
Boyan Zhang
698424a7e34659da7e1f4eb1
Boyang Liu
698424a7e34659da7e1f4eb2
Caiji Zhang
698424a7e34659da7e1f4eb3
Can Li
698424a7e34659da7e1f4eb4
Chang Xu
698424a7e34659da7e1f4eb5
Chao Pang
698424a7e34659da7e1f4eb6
Chao Zhang
698424a7e34659da7e1f4eb7
Chaoyi Yuan
698424a7e34659da7e1f4eb8
Chen Chen
698424a7e34659da7e1f4eb9
Cheng Cui
claimed_verified
2026-02-06T18:53:19.885Z
65a5231a087d8a2e9cc2414b
https://cdn-avatars.huggingface.co/v1/production/uploads/65a5231a087d8a2e9cc2414b/wj0l5R5LmBUG-E8XTMdBM.jpeg
cuicheng
ChengCui
user
ChengCui
698424a7e34659da7e1f4eba
Chenlin Yin
698424a7e34659da7e1f4ebb
Chun Gan
698424a7e34659da7e1f4ebc
Chunguang Chai
698424a7e34659da7e1f4ebd
Chuyu Fang
698424a7e34659da7e1f4ebe
Cuiyun Han
698424a7e34659da7e1f4ebf
Dan Zhang
698424a7e34659da7e1f4ec0
Danlei Feng
698424a7e34659da7e1f4ec1
Danxiang Zhu
698424a7e34659da7e1f4ec2
Dong Sun
698424a7e34659da7e1f4ec3
Dongbo Li
698424a7e34659da7e1f4ec4
Dongdong Li
698424a7e34659da7e1f4ec5
Dongdong Liu
698424a7e34659da7e1f4ec6
Dongxue Liu
698424a7e34659da7e1f4ec7
Fan Ding
698424a7e34659da7e1f4ec8
Fan Hu
698424a7e34659da7e1f4ec9
Fan Li
698424a7e34659da7e1f4eca
Fan Mo
698424a7e34659da7e1f4ecb
Feisheng Wu
698424a7e34659da7e1f4ecc
Fengwei Liu
698424a7e34659da7e1f4ecd
Gangqiang Hu
698424a7e34659da7e1f4ece
Gaofeng Lu
698424a7e34659da7e1f4ecf
Gaopeng Yong
698424a7e34659da7e1f4ed0
Gexiao Tian
698424a7e34659da7e1f4ed1
Guan Wang
claimed_verified
2026-02-05T10:53:38.213Z
698419de94015f1e5eedacec
/avatars/e80baa6f9efcd5e5d7cc9b93ac852c7b.svg
Guan Wang
guanwcn
user
guanwcn
698424a7e34659da7e1f4ed2
Guangchen Ni
698424a7e34659da7e1f4ed3
Guangshuo Wu
698424a7e34659da7e1f4ed4
Guanzhong Wang
698424a7e34659da7e1f4ed5
Guihua Liu
claimed_verified
2026-02-05T10:53:31.029Z
609cd5ab335f23cd2fa0f211
/avatars/8331a7025a6aa4eabc5b6502bf8a0a63.svg
Guihua Liu
LLLL
user
LLLL
698424a7e34659da7e1f4ed6
Guishun Li
698424a7e34659da7e1f4ed7
Haibin Li
698424a7e34659da7e1f4ed8
Haijian Liang
698424a7e34659da7e1f4ed9
Haipeng Ming
698424a7e34659da7e1f4eda
Haisu Wang
698424a7e34659da7e1f4edb
Haiyang Lu
698424a7e34659da7e1f4edc
Haiye Lin
698424a7e34659da7e1f4edd
Han Zhou
698424a7e34659da7e1f4ede
Hangting Lou
698424a7e34659da7e1f4edf
Hanwen Du
698424a7e34659da7e1f4ee0
Hanzhi Zhang
698424a7e34659da7e1f4ee1
Hao Chen
698424a7e34659da7e1f4ee2
Hao Du
698424a7e34659da7e1f4ee3
Hao Liu
698424a7e34659da7e1f4ee4
Hao Zhou
698424a7e34659da7e1f4ee5
Haochen Jiang
698424a7e34659da7e1f4ee6
Haodong Tian
698424a7e34659da7e1f4ee7
Haoshuang Wang
698424a7e34659da7e1f4ee8
Haozhe Geng
698424a7e34659da7e1f4ee9
Heju Yin
698424a7e34659da7e1f4eea
Hong Chen
698424a7e34659da7e1f4eeb
Hongchen Xue
698424a7e34659da7e1f4eec
Hongen Liu
698424a7e34659da7e1f4eed
Honggeng Zhang
698424a7e34659da7e1f4eee
Hongji Xu
698424a7e34659da7e1f4eef
Hongwei Chen
698424a7e34659da7e1f4ef0
Hongyang Zhang
698424a7e34659da7e1f4ef1
Hongyuan Zhang
698424a7e34659da7e1f4ef2
Hua Lu
698424a7e34659da7e1f4ef3
Huan Chen
698424a7e34659da7e1f4ef4
Huan Wang
698424a7e34659da7e1f4ef5
Huang He
698424a7e34659da7e1f4ef6
Hui Liu
698424a7e34659da7e1f4ef7
Hui Zhong
698424a7e34659da7e1f4ef8
Huibin Ruan
698424a7e34659da7e1f4ef9
Jiafeng Lu
698424a7e34659da7e1f4efa
Jiage Liang
698424a7e34659da7e1f4efb
Jiahao Hu
698424a7e34659da7e1f4efc
Jiahao Hu
698424a7e34659da7e1f4efd
Jiajie Yang
698424a7e34659da7e1f4efe
Jialin Li
698424a7e34659da7e1f4eff
Jian Chen
698424a7e34659da7e1f4f00
Jian Wu
698424a7e34659da7e1f4f01
Jianfeng Yang
698424a7e34659da7e1f4f02
Jianguang Jiang
698424a7e34659da7e1f4f03
Jianhua Wang
698424a7e34659da7e1f4f04
Jianye Chen
698424a7e34659da7e1f4f05
Jiaodi Liu
698424a7e34659da7e1f4f06
Jiarui Zhou
698424a7e34659da7e1f4f07
Jiawei Lv
698424a7e34659da7e1f4f08
Jiaxin Zhou
698424a7e34659da7e1f4f09
Jiaxuan Liu
698424a7e34659da7e1f4f0a
Jie Han
698424a7e34659da7e1f4f0b
Jie Sun
698424a7e34659da7e1f4f0c
Jiefan Fang
698424a7e34659da7e1f4f0d
Jihan Liu
698424a7e34659da7e1f4f0e
Jihua Liu
698424a7e34659da7e1f4f0f
Jing Hu
698424a7e34659da7e1f4f10
Jing Qian
698424a7e34659da7e1f4f11
Jing Yan
698424a7e34659da7e1f4f12
Jingdong Du
698424a7e34659da7e1f4f13
Jingdong Wang
698424a7e34659da7e1f4f14
Jingjing Wu
698424a7e34659da7e1f4f15
Jingyong Li
698424a7e34659da7e1f4f16
Jinheng Wang
698424a7e34659da7e1f4f17
Jinjin Li
698424a7e34659da7e1f4f18
Jinliang Lu
698424a7e34659da7e1f4f19
Jinlin Yu
698424a7e34659da7e1f4f1a
Jinnan Liu
698424a7e34659da7e1f4f1b
Jixiang Feng
698424a7e34659da7e1f4f1c
Jiyi Huang
698424a7e34659da7e1f4f1d
Jiyuan Zhang
698424a7e34659da7e1f4f1e
Jun Liang
698424a7e34659da7e1f4f1f
Jun Xia
698424a7e34659da7e1f4f20
Jun Yu
698424a7e34659da7e1f4f21
Junda Chen
698424a7e34659da7e1f4f22
Junhao Feng
698424a7e34659da7e1f4f23
Junhong Xiang
698424a7e34659da7e1f4f24
Junliang Li
claimed_verified
2026-02-09T08:35:52.201Z
65e5338dedc2f7306ec66561
/avatars/c34adbcefce9858d3ef1e247bfb1be67.svg
Junliang Li
JunliangLi
user
JunliangLi
698424a7e34659da7e1f4f25
Kai Liu
698424a7e34659da7e1f4f26
Kailun Chen
698424a7e34659da7e1f4f27
Kairan Su
698424a7e34659da7e1f4f28
Kang Hu
698424a7e34659da7e1f4f29
Kangkang Zhou
698424a7e34659da7e1f4f2a
Ke Chen
698424a7e34659da7e1f4f2b
Ke Wei
698424a7e34659da7e1f4f2c
Kui Huang
698424a7e34659da7e1f4f2d
Kun Wu
698424a7e34659da7e1f4f2e
Kunbin Chen
698424a7e34659da7e1f4f2f
Lei Han
698424a7e34659da7e1f4f30
Lei Sun
698424a7e34659da7e1f4f31
Lei Wen
claimed_verified
2026-02-06T18:53:54.801Z
68cc085a93626e1876b733b6
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Ru8FZA05vt4f2QNSEz9Rz.png
wenlei
qwes5s5
user
qwes5s5
698424a7e34659da7e1f4f32
Linghui Meng
698424a7e34659da7e1f4f33
Linhao Yu
claimed_verified
2026-02-05T10:52:47.812Z
641e69355c348064a8251471
/avatars/acad3877df27ff44ea3921bb43e34d53.svg
Linhao Yu
HasuerYu
user
HasuerYu
698424a7e34659da7e1f4f34
Liping Ouyang
698424a7e34659da7e1f4f35
Liwen Zhang
698424a7e34659da7e1f4f36
Longbin Ji
claimed_verified
2026-02-05T10:53:40.295Z
65cf859f88d13d8128bb8545
/avatars/aa18b993bd90d9c8a95913050cd955a8.svg
Longbin Ji
robingg1
user
robingg1
698424a7e34659da7e1f4f37
Longzhi Wang
698424a7e34659da7e1f4f38
Meng Sun
698424a7e34659da7e1f4f39
Meng Tian
698424a7e34659da7e1f4f3a
Mengfei Li
698424a7e34659da7e1f4f3b
Mengqi Zeng
698424a7e34659da7e1f4f3c
Mengyu Zhang
698424a7e34659da7e1f4f3d
Ming Hong
698424a7e34659da7e1f4f3e
Mingcheng Zhou
698424a7e34659da7e1f4f3f
Mingming Huang
698424a7e34659da7e1f4f40
Mingxin Chen
698424a7e34659da7e1f4f41
Mingzhu Cai
698424a7e34659da7e1f4f42
Naibin Gu
698424a7e34659da7e1f4f43
Nemin Qiu
698424a7e34659da7e1f4f44
Nian Wang
698424a7e34659da7e1f4f45
Peng Qiu
698424a7e34659da7e1f4f46
Peng Zhao
698424a7e34659da7e1f4f47
Pengyu Zou
claimed_verified
2026-02-06T18:53:22.259Z
6715f1953f36e628d6e27272
/avatars/4a5262219a273c41c7ad8ef627ffc0d6.svg
Hawk Zou
Hawkpy
user
Hawkpy
698424a7e34659da7e1f4f48
Qi Wang
698424a7e34659da7e1f4f49
Qi Xin
698424a7e34659da7e1f4f4a
Qian Wang
698424a7e34659da7e1f4f4b
Qiang Zhu
698424a7e34659da7e1f4f4c
Qianhui Luo
698424a7e34659da7e1f4f4d
Qianwei Yang
698424a7e34659da7e1f4f4e
Qianyue He
698424a7e34659da7e1f4f4f
Qifei Wu
698424a7e34659da7e1f4f50
Qinrui Li
698424a7e34659da7e1f4f51
Qiwen Bao
698424a7e34659da7e1f4f52
Quan Zhang
698424a7e34659da7e1f4f53
Quanxiang Liu
698424a7e34659da7e1f4f54
Qunyi Xie
698424a7e34659da7e1f4f55
Rongrui Zhan
698424a7e34659da7e1f4f56
Rufeng Dai
698424a7e34659da7e1f4f57
Rui Peng
698424a7e34659da7e1f4f58
Ruian Liu
698424a7e34659da7e1f4f59
Ruihao Xu
698424a7e34659da7e1f4f5a
Ruijie Wang
698424a7e34659da7e1f4f5b
Ruixi Zhang
698424a7e34659da7e1f4f5c
Ruixuan Liu
698424a7e34659da7e1f4f5d
Runsheng Shi
698424a7e34659da7e1f4f5e
Ruting Wang
698424a7e34659da7e1f4f5f
Senbo Kang
698424a7e34659da7e1f4f60
Shan Lu
698424a7e34659da7e1f4f61
Shaofei Yu
698424a7e34659da7e1f4f62
Shaotian Gong
698424a7e34659da7e1f4f63
Shenwei Hu
698424a7e34659da7e1f4f64
Shifeng Zheng
698424a7e34659da7e1f4f65
Shihao Guo
698424a7e34659da7e1f4f66
Shilong Fan
698424a7e34659da7e1f4f67
Shiqin Liu
698424a7e34659da7e1f4f68
Shiwei Gu
698424a7e34659da7e1f4f69
Shixi Zhang
698424a7e34659da7e1f4f6a
Shuai Yao
698424a7e34659da7e1f4f6b
Shuang Zhang
698424a7e34659da7e1f4f6c
Shuangqiao Liu
698424a7e34659da7e1f4f6d
Shuhao Liang
698424a7e34659da7e1f4f6e
Shuwei He
698424a7e34659da7e1f4f6f
Shuwen Yang
698424a7e34659da7e1f4f70
Sijun He
claimed_verified
2026-02-05T10:53:33.392Z
62769a608483d8e9ecd9b4f8
https://cdn-avatars.huggingface.co/v1/production/uploads/1672799958233-62769a608483d8e9ecd9b4f8.jpeg
Sijun He
sijunhe
user
sijunhe
698424a7e34659da7e1f4f71
Siming Dai
claimed_verified
2026-02-05T10:52:50.302Z
64fada13d82fc6977d5e9c74
/avatars/776bf1257154289e919716637770ef52.svg
Siming Dai
DesmonDay
user
DesmonDay
698424a7e34659da7e1f4f72
Siming Wu
698424a7e34659da7e1f4f73
Siyi Long
698424a7e34659da7e1f4f74
Songhe Deng
698424a7e34659da7e1f4f75
Suhui Dong
698424a7e34659da7e1f4f76
Suyin Liang
698424a7e34659da7e1f4f77
Teng Hu
698424a7e34659da7e1f4f78
Tianchan Xu
698424a7e34659da7e1f4f79
Tianliang Lv
698424a7e34659da7e1f4f7a
Tianmeng Yang
claimed_verified
2026-02-05T10:53:36.143Z
67bbe929593452cc18877606
/avatars/f50fd1cb35d628c26cf21ad0c95c55b1.svg
tmyangcs
youngtimmy
user
youngtimmy
698424a7e34659da7e1f4f7b
Tianyi Wei
698424a7e34659da7e1f4f7c
Tiezhu Gao
698424a7e34659da7e1f4f7d
Ting Sun
698424a7e34659da7e1f4f7e
Ting Zhang
698424a7e34659da7e1f4f7f
Tingdan Luo
698424a7e34659da7e1f4f80
Wei He
698424a7e34659da7e1f4f81
Wei Luan
698424a7e34659da7e1f4f82
Wei Yin
698424a7e34659da7e1f4f83
Wei Zhang
698424a7e34659da7e1f4f84
Wei Zhou
698424a7e34659da7e1f4f85
Weibao Gong
698424a7e34659da7e1f4f86
Weibin Li
698424a7e34659da7e1f4f87
Weicheng Huang
698424a7e34659da7e1f4f88
Weichong Dang
698424a7e34659da7e1f4f89
Weiguo Zhu
698424a7e34659da7e1f4f8a
Weilong Zhang
698424a7e34659da7e1f4f8b
Weiqi Tan
698424a7e34659da7e1f4f8c
Wen Huang
698424a7e34659da7e1f4f8d
Wenbin Chang
698424a7e34659da7e1f4f8e
Wenjing Du
698424a7e34659da7e1f4f8f
Wenlong Miao
698424a7e34659da7e1f4f90
Wenpei Luo
698424a7e34659da7e1f4f91
Wenquan Wu
698424a7e34659da7e1f4f92
Xi Shi
698424a7e34659da7e1f4f93
Xi Zhao
698424a7e34659da7e1f4f94
Xiang Gao
698424a7e34659da7e1f4f95
Xiangguo Zhang
698424a7e34659da7e1f4f96
Xiangrui Yu
698424a7e34659da7e1f4f97
Xiangsen Wang
698424a7e34659da7e1f4f98
Xiangzhe Wang
698424a7e34659da7e1f4f99
Xianlong Luo
698424a7e34659da7e1f4f9a
Xianying Ma
698424a7e34659da7e1f4f9b
Xiao Tan
698424a7e34659da7e1f4f9c
Xiaocong Lin
698424a7e34659da7e1f4f9d
Xiaofei Wang
698424a7e34659da7e1f4f9e
Xiaofeng Peng
698424a7e34659da7e1f4f9f
Xiaofeng Wu
claimed_verified
2026-02-06T18:53:24.158Z
65b87081d49f4330ab31b727
/avatars/2d8b9a2193dc0b8bf9b010ac74ef43a8.svg
Xiaofeng Wu
XiaofengWu1028
user
XiaofengWu1028
698424a7e34659da7e1f4fa0
Xiaojian Xu
698424a7e34659da7e1f4fa1
Xiaolan Yuan
698424a7e34659da7e1f4fa2
Xiaopeng Cui
698424a7e34659da7e1f4fa3
Xiaotian Han
698424a7e34659da7e1f4fa4
Xiaoxiong Liu
698424a7e34659da7e1f4fa5
Xiaoxu Fei
698424a7e34659da7e1f4fa6
Xiaoxuan Wu
698424a7e34659da7e1f4fa7
Xiaoyu Wang
claimed_verified
2026-02-05T10:53:25.774Z
664395621b88258a527cd7d1
/avatars/8489ccebe4fd1262679ba63a5cb50bb8.svg
Kira
Kira-wang
user
Kira-wang
698424a7e34659da7e1f4fa8
Xiaoyu Zhang
698424a7e34659da7e1f4fa9
Xin Sun
698424a7e34659da7e1f4faa
Xin Wang
698424a7e34659da7e1f4fab
Xinhui Huang
698424a7e34659da7e1f4fac
Xinming Zhu
698424a7e34659da7e1f4fad
Xintong Yu
698424a7e34659da7e1f4fae
Xinyi Xu
698424a7e34659da7e1f4faf
Xinyu Wang
698424a7e34659da7e1f4fb0
Xiuxian Li
698424a7e34659da7e1f4fb1
XuanShi Zhu
698424a7e34659da7e1f4fb2
Xue Xu
698424a7e34659da7e1f4fb3
Xueying Lv
698424a7e34659da7e1f4fb4
Xuhong Li
698424a7e34659da7e1f4fb5
Xulong Wei
698424a7e34659da7e1f4fb6
Xuyi Chen
698424a7e34659da7e1f4fb7
Yabing Shi
698424a7e34659da7e1f4fb8
Yafeng Wang
698424a7e34659da7e1f4fb9
Yamei Li
698424a7e34659da7e1f4fba
Yan Liu
698424a7e34659da7e1f4fbb
Yanfu Cheng
698424a7e34659da7e1f4fbc
Yang Gao
698424a7e34659da7e1f4fbd
Yang Liang
698424a7e34659da7e1f4fbe
Yang Wang
698424a7e34659da7e1f4fbf
Yang Wang
698424a7e34659da7e1f4fc0
Yang Yang
698424a7e34659da7e1f4fc1
Yanlong Liu
698424a7e34659da7e1f4fc2
Yannian Fu
698424a7e34659da7e1f4fc3
Yanpeng Wang
698424a7e34659da7e1f4fc4
Yanzheng Lin
698424a7e34659da7e1f4fc5
Yao Chen
698424a7e34659da7e1f4fc6
Yaozong Shen
698424a7e34659da7e1f4fc7
Yaqian Han
698424a7e34659da7e1f4fc8
Yehua Yang
698424a7e34659da7e1f4fc9
Yekun Chai
698424a7e34659da7e1f4fca
Yesong Wang
698424a7e34659da7e1f4fcb
Yi Song
698424a7e34659da7e1f4fcc
Yichen Zhang
698424a7e34659da7e1f4fcd
Yifei Wang
698424a7e34659da7e1f4fce
Yifeng Guo
698424a7e34659da7e1f4fcf
Yifeng Kou
698424a7e34659da7e1f4fd0
Yilong Chen
698424a7e34659da7e1f4fd1
Yilong Guo
698424a7e34659da7e1f4fd2
Yiming Wang
698424a7e34659da7e1f4fd3
Ying Chen
698424a7e34659da7e1f4fd4
Ying Wang
698424a7e34659da7e1f4fd5
Yingsheng Wu
698424a7e34659da7e1f4fd6
Yingzhan Lin
698424a7e34659da7e1f4fd7
Yinqi Yang
698424a7e34659da7e1f4fd8
Yiran Xing
698424a7e34659da7e1f4fd9
Yishu Lei
698424a7e34659da7e1f4fda
Yixiang Tu
698424a7e34659da7e1f4fdb
Yiyan Chen
698424a7e34659da7e1f4fdc
Yong Zhang
698424a7e34659da7e1f4fdd
Yonghua Li
698424a7e34659da7e1f4fde
Yongqiang Ma
698424a7e34659da7e1f4fdf
Yongxing Dai
698424a7e34659da7e1f4fe0
Yongyue Zhang
698424a7e34659da7e1f4fe1
Yu Ran
698424a7e34659da7e1f4fe2
Yu Sun
698424a7e34659da7e1f4fe3
Yu-Wen Michael Zhang
698424a7e34659da7e1f4fe4
Yuang Liu
698424a7e34659da7e1f4fe5
Yuanle Liu
698424a7e34659da7e1f4fe6
Yuanyuan Zhou
698424a7e34659da7e1f4fe7
Yubo Zhang
698424a7e34659da7e1f4fe8
Yuchen Han
698424a7e34659da7e1f4fe9
Yucheng Wang
698424a7e34659da7e1f4fea
Yude Gao
698424a7e34659da7e1f4feb
Yuedong Luo
698424a7e34659da7e1f4fec
Yuehu Dong
698424a7e34659da7e1f4fed
Yufeng Hu
698424a7e34659da7e1f4fee
Yuhui Cao
698424a7e34659da7e1f4fef
Yuhui Yun
claimed_verified
2026-02-06T18:53:45.302Z
66aa31e5c9add038139046e2
/avatars/43d039a6b5314d150a8a21448feec975.svg
Yuhui Yun
RojoYun
user
RojoYun
698424a7e34659da7e1f4ff0
Yukun Chen
698424a7e34659da7e1f4ff1
Yukun Gao
698424a7e34659da7e1f4ff2
Yukun Li
698424a7e34659da7e1f4ff3
Yumeng Zhang
698424a7e34659da7e1f4ff4
Yun Fan
698424a7e34659da7e1f4ff5
Yun Ma
698424a7e34659da7e1f4ff6
Yunfei Zhang
698424a7e34659da7e1f4ff7
Yunshen Xie
698424a7e34659da7e1f4ff8
Yuping Xu
698424a7e34659da7e1f4ff9
Yuqin Zhang
698424a7e34659da7e1f4ffa
Yuqing Liu
698424a7e34659da7e1f4ffb
Yurui Li
698424a7e34659da7e1f4ffc
Yuwen Wang
698424a7e34659da7e1f4ffd
Yuxiang Lu
698424a7e34659da7e1f4ffe
Zefeng Cai
698424a7e34659da7e1f4fff
Zelin Zhao
698424a7e34659da7e1f5000
Zelun Zhang
698424a7e34659da7e1f5001
Zenan Lin
698424a7e34659da7e1f5002
Zezhao Dong
698424a7e34659da7e1f5003
Zhaowu Pan
698424a7e34659da7e1f5004
Zhaoyu Liu
698424a7e34659da7e1f5005
Zhe Dong
698424a7e34659da7e1f5006
Zhe Zhang
698424a7e34659da7e1f5007
Zhen Zhang
698424a7e34659da7e1f5008
Zhengfan Wu
698424a7e34659da7e1f5009
Zhengrui Wei
698424a7e34659da7e1f500a
Zhengsheng Ning
698424a7e34659da7e1f500b
Zhenxing Li
698424a7e34659da7e1f500c
Zhenyu Li
698424a7e34659da7e1f500d
Zhenyu Qian
698424a7e34659da7e1f500e
Zhenyun Li
698424a7e34659da7e1f500f
Zhi Li
698424a7e34659da7e1f5010
Zhichao Chen
698424a7e34659da7e1f5011
Zhicheng Dong
698424a7e34659da7e1f5012
Zhida Feng
698424a7e34659da7e1f5013
Zhifan Feng
698424a7e34659da7e1f5014
Zhihao Deng
698424a7e34659da7e1f5015
Zhijin Yu
698424a7e34659da7e1f5016
Zhiyang Chen
698424a7e34659da7e1f5017
Zhonghui Zheng
698424a7e34659da7e1f5018
Zhuangzhuang Guo
698424a7e34659da7e1f5019
Zhujun Zhang
698424a7e34659da7e1f501a
Zhuo Sun
698424a7e34659da7e1f501b
Zichang Liu
698424a7e34659da7e1f501c
Zihan Lin
698424a7e34659da7e1f501d
Zihao Huang
698424a7e34659da7e1f501e
Zihe Zhu
698424a7e34659da7e1f501f
Ziheng Zhao
698424a7e34659da7e1f5020
Ziping Chen
admin_assigned
2026-02-06T15:34:56.155Z
6544c0ef4200ae379ea857d1
/avatars/69af6a92d44a02f713e4acc9f772144d.svg
Ziping Chen
ZZZ0007
user
ZZZ0007
698424a7e34659da7e1f5021
Zixuan Zhu
698424a7e34659da7e1f5022
Ziyang Xu
698424a7e34659da7e1f5023
Ziyi Liang
698424a7e34659da7e1f5024
Ziyuan Gao
ERNIE 5.0 Technical Report
In this report, we introduce ERNIE 5.0, a natively autoregressive foundation model desinged for unified multimodal understanding and generation across text, image, video, and audio. All modalities are trained from scratch under a unified next-group-of-tokens prediction objective, based on an ultra-sparse mixture-of-experts (MoE) architecture with modality-agnostic expert routing. To address practical challenges in large-scale deployment under diverse resource constraints, ERNIE 5.0 adopts a novel elastic training paradigm. Within a single pre-training run, the model learns a family of sub-models with varying depths, expert capacities, and routing sparsity, enabling flexible trade-offs among performance, model size, and inference latency in memory- or time-constrained scenarios. Moreover, we systematically address the challenges of scaling reinforcement learning to unified foundation models, thereby guaranteeing efficient and stable post-training under ultra-sparse MoE architectures and diverse multimodal settings. Extensive experiments demonstrate that ERNIE 5.0 achieves strong and balanced performance across multiple modalities. To the best of our knowledge, among publicly disclosed models, ERNIE 5.0 represents the first production-scale realization of a trillion-parameter unified autoregressive model that supports both multimodal understanding and generation. To facilitate further research, we present detailed visualizations of modality-agnostic expert routing in the unified model, alongside comprehensive empirical analysis of elastic training, aiming to offer profound insights to the community.
ERNIE 5.0 is a production-scale trillion-parameter autoregressive model that unifies multimodal understanding and generation through sparse MoE architecture and elastic training.
autoregressive foundation model unified multimodal understanding unified next-group-of-tokens prediction objective mixture-of-experts modality-agnostic expert routing elastic training paradigm reinforcement learning sparse MoE architecture