MiMo-V2-Flash Technical Report
We present MiMo-V2-Flash, a Mixture-of-Experts (MoE) model with 309B total parameters and 15B active parameters, designed for fast, strong reasoning and agentic capabilities. MiMo-V2-Flash adopts a hybrid attention architecture that interleaves Sliding Window Attention (SWA) with global attention, with a 128-token sliding window under a 5:1 hybrid ratio. The model is pre-trained on 27 trillion tokens with Multi-Token Prediction (MTP), employing a native 32k context length and subsequently extended to 256k. To efficiently scale post-training compute, MiMo-V2-Flash introduces a novel Multi-Teacher On-Policy Distillation (MOPD) paradigm. In this framework, domain-specialized teachers (e.g., trained via large-scale reinforcement learning) provide dense and token-level reward, enabling the student model to perfectly master teacher expertise. MiMo-V2-Flash rivals top-tier open-weight models such as DeepSeek-V3.2 and Kimi-K2, despite using only 1/2 and 1/3 of their total parameters, respectively. During inference, by repurposing MTP as a draft model for speculative decoding, MiMo-V2-Flash achieves up to 3.6 acceptance length and 2.6x decoding speedup with three MTP layers. We open-source both the model weights and the three-layer MTP weights to foster open research and community collaboration.
695dd171c03d6d81e4399ef4
Bangjun Xiao
admin_assigned
2026-01-07T13:25:11.197Z
6732130e07f893d9c185c908
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/C31Me-ujgNy5k2KLL5hh6.png
bangjun xiao
xbjpku
user
xbjpku
695dd171c03d6d81e4399ef5
Bingquan Xia
admin_assigned
2026-01-07T13:25:19.374Z
6348c3cda6aa28fa6313e906
/avatars/2c0f0b08b1371689ebb4df18ddf45e54.svg
Bingquan Xia
xiabingquan
user
xiabingquan
695dd171c03d6d81e4399ef6
Bo Yang
claimed_verified
2026-01-07T09:25:53.834Z
693ee055a14dfa27729d6684
/avatars/3ae4edc04cc740ca61f6f8e4ad011413.svg
mi-yb
ami-yb
user
ami-yb
695dd171c03d6d81e4399ef7
Bofei Gao
admin_assigned
2026-01-07T13:25:37.497Z
65ae21adabf6d1ccb795e9a4
/avatars/b5dced62c6a3564095a8fa0959bc06cb.svg
Bofei Gao
KbsdJames
user
KbsdJames
695dd171c03d6d81e4399ef8
Bowen Shen
695dd171c03d6d81e4399ef9
Chen Zhang
695dd171c03d6d81e4399efa
Chenhong He
admin_assigned
2026-01-07T13:26:21.940Z
6829e9379292b4796b6d9124
/avatars/838acf681fce69703737d31845f4bef0.svg
chen honghe
chenhonghe
user
chenhonghe
695dd171c03d6d81e4399efb
Chiheng Lou
admin_assigned
2026-01-07T13:26:29.953Z
6528be15578679aac79e925f
/avatars/bd5dbb3ff43b2faa034c4cd381263d9c.svg
Chiheng Lou
gjghfd
user
gjghfd
695dd171c03d6d81e4399efc
Fuli Luo
admin_assigned
2026-01-07T13:26:36.566Z
6538815d1bdb3c40db94fbfa
https://cdn-avatars.huggingface.co/v1/production/uploads/6538815d1bdb3c40db94fbfa/id7aSY8JUgKK2agKWLERt.jpeg
Fuli Luo
luofuli
user
luofuli
695dd171c03d6d81e4399efd
Gang Wang
695dd171c03d6d81e4399efe
Gang Xie
695dd171c03d6d81e4399eff
Hailin Zhang
695dd171c03d6d81e4399f00
Hanglong Lv
695dd171c03d6d81e4399f01
Hanyu Li
695dd171c03d6d81e4399f02
Heyu Chen
695dd171c03d6d81e4399f03
Hongshen Xu
695dd171c03d6d81e4399f04
Houbin Zhang
695dd171c03d6d81e4399f05
Huaqiu Liu
claimed_verified
2026-01-09T15:46:16.660Z
680e9a219e529f779991be0c
/avatars/327b945649192b0881fe290298d10e23.svg
Huaqiu Liu
Prestonprom
user
Prestonprom
695dd171c03d6d81e4399f06
Jiangshan Duo
695dd171c03d6d81e4399f07
Jianyu Wei
695dd171c03d6d81e4399f08
Jiebao Xiao
695dd171c03d6d81e4399f09
Jinhao Dong
695dd171c03d6d81e4399f0a
Jun Shi
695dd171c03d6d81e4399f0b
Junhao Hu
695dd171c03d6d81e4399f0c
Kainan Bao
695dd171c03d6d81e4399f0d
Kang Zhou
695dd171c03d6d81e4399f0e
Lei Li
claimed_verified
2026-04-08T08:08:16.731Z
6038d6d0612f5eef3cc05ea9
https://cdn-avatars.huggingface.co/v1/production/uploads/6038d6d0612f5eef3cc05ea9/ryhvAX5djQpD5OrIlZQ1f.jpeg
Lei Li
tobiaslee
user
tobiaslee
695dd171c03d6d81e4399f0f
Liang Zhao
695dd171c03d6d81e4399f10
Linghao Zhang
695dd171c03d6d81e4399f11
Peidian Li
695dd171c03d6d81e4399f12
Qianli Chen
695dd171c03d6d81e4399f13
Shaohui Liu
695dd171c03d6d81e4399f14
Shihua Yu
695dd171c03d6d81e4399f15
Shijie Cao
695dd171c03d6d81e4399f16
Shimao Chen
claimed_verified
2026-01-07T09:25:44.714Z
64f5216e3c9b5e07f85582e3
https://cdn-avatars.huggingface.co/v1/production/uploads/64f5216e3c9b5e07f85582e3/tWe8_9R2nNxQpPv-wa4nB.jpeg
Ezio Chen
Ezioii
user
Ezioii
695dd171c03d6d81e4399f17
Shouqiu Yu
695dd171c03d6d81e4399f18
Shuo Liu
695dd171c03d6d81e4399f19
Tianling Zhou
695dd171c03d6d81e4399f1a
Weijiang Su
695dd171c03d6d81e4399f1b
Weikun Wang
695dd171c03d6d81e4399f1c
Wenhan Ma
695dd171c03d6d81e4399f1d
Xiangwei Deng
695dd171c03d6d81e4399f1e
Bohan Mao
695dd171c03d6d81e4399f1f
Bowen Ye
claimed_verified
2026-04-09T18:53:01.628Z
663f2e2d9efa4d370061f6f6
/avatars/6e1391b66870f03b65c3fe346b6c37c0.svg
BoWen Ye
Ymiracle
user
Ymiracle
695dd171c03d6d81e4399f20
Can Cai
695dd171c03d6d81e4399f21
Chenghua Wang
695dd171c03d6d81e4399f22
Chengxuan Zhu
695dd171c03d6d81e4399f23
Chong Ma
695dd171c03d6d81e4399f24
Chun Chen
695dd171c03d6d81e4399f25
Chunan Li
695dd171c03d6d81e4399f26
Dawei Zhu
695dd171c03d6d81e4399f27
Deshan Xiao
695dd171c03d6d81e4399f28
Dong Zhang
695dd171c03d6d81e4399f29
Duo Zhang
695dd171c03d6d81e4399f2a
Fangyue Liu
695dd171c03d6d81e4399f2b
Feiyu Yang
695dd171c03d6d81e4399f2c
Fengyuan Shi
695dd171c03d6d81e4399f2d
Guoan Wang
695dd171c03d6d81e4399f2e
Hao Tian
695dd171c03d6d81e4399f2f
Hao Wu
695dd171c03d6d81e4399f30
Heng Qu
695dd171c03d6d81e4399f31
Hongfei Yi
695dd171c03d6d81e4399f32
Hongxu An
695dd171c03d6d81e4399f33
Hongyi Guan
695dd171c03d6d81e4399f34
Xing Zhang
695dd171c03d6d81e4399f35
Yifan Song
695dd171c03d6d81e4399f36
Yihan Yan
695dd171c03d6d81e4399f37
Yihao Zhao
695dd171c03d6d81e4399f38
Yingchun Lai
695dd171c03d6d81e4399f39
Yizhao Gao
695dd171c03d6d81e4399f3a
Yu Cheng
695dd171c03d6d81e4399f3b
Yuanyuan Tian
695dd171c03d6d81e4399f3c
Yudong Wang
695dd171c03d6d81e4399f3d
Zhen Tang
695dd171c03d6d81e4399f3e
Zhengju Tang
695dd171c03d6d81e4399f3f
Zhengtao Wen
695dd171c03d6d81e4399f40
Zhichao Song
695dd171c03d6d81e4399f41
Zhixian Zheng
695dd171c03d6d81e4399f42
Zihan Jiang
claimed_verified
2026-01-07T09:25:47.154Z
665ee916b9e194a20c4769da
/avatars/cfb3ff26979bed1a0c65a6fa318af3ad.svg
Zihan Jiang
Jumbo0715
user
Jumbo0715
695dd171c03d6d81e4399f43
Jian Wen
695dd171c03d6d81e4399f44
Jiarui Sun
695dd171c03d6d81e4399f45
Jiawei Li
695dd171c03d6d81e4399f46
Jinlong Xue
695dd171c03d6d81e4399f47
Jun Xia
695dd171c03d6d81e4399f48
Kai Fang
695dd171c03d6d81e4399f49
Menghang Zhu
695dd171c03d6d81e4399f4a
Nuo Chen
695dd171c03d6d81e4399f4b
Qian Tu
695dd171c03d6d81e4399f4c
Qihao Zhang
695dd171c03d6d81e4399f4d
Qiying Wang
695dd171c03d6d81e4399f4e
Rang Li
claimed_verified
2026-02-11T11:20:58.685Z
6847abd1892b779986a5ec80
/avatars/0f820eedf74d8e0636af94ef7cd4d04c.svg
Rang Li
lirang04
user
lirang04
695dd171c03d6d81e4399f4f
Rui Ma
695dd171c03d6d81e4399f50
Shaolei Zhang
695dd171c03d6d81e4399f51
Shengfan Wang
695dd171c03d6d81e4399f52
Shicheng Li
695dd171c03d6d81e4399f53
Shuhao Gu
695dd171c03d6d81e4399f54
Shuhuai Ren
695dd171c03d6d81e4399f55
Sirui Deng
695dd171c03d6d81e4399f56
Tao Guo
695dd171c03d6d81e4399f57
Tianyang Lu
695dd171c03d6d81e4399f58
Weiji Zhuang
695dd171c03d6d81e4399f59
Weikang Zhang
695dd171c03d6d81e4399f5a
Weimin Xiong
695dd171c03d6d81e4399f5b
Wenshan Huang
695dd171c03d6d81e4399f5c
Wenyu Yang
695dd171c03d6d81e4399f5d
Xin Zhang
695dd171c03d6d81e4399f5e
Xing Yong
695dd171c03d6d81e4399f5f
Xu Wang
695dd171c03d6d81e4399f60
Xueyang Xie
695dd171c03d6d81e4399f61
Yilin Jiang
695dd171c03d6d81e4399f62
Yixin Yang
695dd171c03d6d81e4399f63
Yongzhe He
695dd171c03d6d81e4399f64
Yu Tu
695dd171c03d6d81e4399f65
Yuanliang Dong
695dd171c03d6d81e4399f66
Yuchen Liu
695dd171c03d6d81e4399f67
Yue Ma
695dd171c03d6d81e4399f68
Yue Yu
695dd171c03d6d81e4399f69
Yuxing Xiang
695dd171c03d6d81e4399f6a
Zhaojun Huang
695dd171c03d6d81e4399f6b
Zhenru Lin
695dd171c03d6d81e4399f6c
Zhipeng Xu
695dd171c03d6d81e4399f6d
Zhiyang Chen
695dd171c03d6d81e4399f6e
Zhonghua Deng
695dd171c03d6d81e4399f6f
Zihan Zhang
695dd171c03d6d81e4399f70
Zihao Yue
MiMo-V2-Flash Technical Report
We present MiMo-V2-Flash, a Mixture-of-Experts (MoE) model with 309B total parameters and 15B active parameters, designed for fast, strong reasoning and agentic capabilities. MiMo-V2-Flash adopts a hybrid attention architecture that interleaves Sliding Window Attention (SWA) with global attention, with a 128-token sliding window under a 5:1 hybrid ratio. The model is pre-trained on 27 trillion tokens with Multi-Token Prediction (MTP), employing a native 32k context length and subsequently extended to 256k. To efficiently scale post-training compute, MiMo-V2-Flash introduces a novel Multi-Teacher On-Policy Distillation (MOPD) paradigm. In this framework, domain-specialized teachers (e.g., trained via large-scale reinforcement learning) provide dense and token-level reward, enabling the student model to perfectly master teacher expertise. MiMo-V2-Flash rivals top-tier open-weight models such as DeepSeek-V3.2 and Kimi-K2, despite using only 1/2 and 1/3 of their total parameters, respectively. During inference, by repurposing MTP as a draft model for speculative decoding, MiMo-V2-Flash achieves up to 3.6 acceptance length and 2.6x decoding speedup with three MTP layers. We open-source both the model weights and the three-layer MTP weights to foster open research and community collaboration.
MiMo-V2-Flash is a sparse Mixture-of-Experts model with hybrid attention architecture and efficient distillation technique that achieves strong performance with reduced parameters and improved inference speed.
Mixture-of-Experts Sliding Window Attention global attention Multi-Token Prediction speculative decoding Multi-Teacher On-Policy Distillation