LLaDA2.1: Speeding Up Text Diffusion via Token Editing
While LLaDA2.0 showcased the scaling potential of 100B-level block-diffusion models and their inherent parallelization, the delicate equilibrium between decoding speed and generation quality has remained an elusive frontier. Today, we unveil LLaDA2.1, a paradigm shift designed to transcend this trade-off. By seamlessly weaving Token-to-Token (T2T) editing into the conventional Mask-to-Token (M2T) scheme, we introduce a joint, configurable threshold-decoding scheme. This structural innovation gives rise to two distinct personas: the Speedy Mode (S Mode), which audaciously lowers the M2T threshold to bypass traditional constraints while relying on T2T to refine the output; and the Quality Mode (Q Mode), which leans into conservative thresholds to secure superior benchmark performances with manageable efficiency degrade. Furthering this evolution, underpinned by an expansive context window, we implement the first large-scale Reinforcement Learning (RL) framework specifically tailored for dLLMs, anchored by specialized techniques for stable gradient estimation. This alignment not only sharpens reasoning precision but also elevates instruction-following fidelity, bridging the chasm between diffusion dynamics and complex human intent. We culminate this work by releasing LLaDA2.1-Mini (16B) and LLaDA2.1-Flash (100B). Across 33 rigorous benchmarks, LLaDA2.1 delivers strong task performance and lightning-fast decoding speed. Despite its 100B volume, on coding tasks it attains an astounding 892 TPS on HumanEval+, 801 TPS on BigCodeBench, and 663 TPS on LiveCodeBench.
698ab6fd1b2dc6b37d61b04b
Tiwei Bie
698ab6fd1b2dc6b37d61b04c
Maosong Cao
698ab6fd1b2dc6b37d61b04d
Xiang Cao
698ab6fd1b2dc6b37d61b04e
Bingsen Chen
698ab6fd1b2dc6b37d61b04f
Fuyuan Chen
698ab6fd1b2dc6b37d61b050
Kun Chen
698ab6fd1b2dc6b37d61b051
Lun Du
698ab6fd1b2dc6b37d61b052
Daozhuo Feng
698ab6fd1b2dc6b37d61b053
Haibo Feng
698ab6fd1b2dc6b37d61b054
Mingliang Gong
698ab6fd1b2dc6b37d61b055
Zhuocheng Gong
698ab6fd1b2dc6b37d61b056
Yanmei Gu
698ab6fd1b2dc6b37d61b057
Jian Guan
698ab6fd1b2dc6b37d61b058
Kaiyuan Guan
claimed_verified
2026-02-10T09:05:52.604Z
6494f6dc32f2c0d7ef28315c
https://cdn-avatars.huggingface.co/v1/production/uploads/6494f6dc32f2c0d7ef28315c/y4TwcrT6UQ9Zfy6BfUMUl.jpeg
Kaiyuan Guan
WilfredG
user
WilfredG
698ab6fd1b2dc6b37d61b059
Hongliang He
698ab6fd1b2dc6b37d61b05a
Zenan Huang
698ab6fd1b2dc6b37d61b05b
Juyong Jiang
claimed_verified
2026-03-12T09:08:06.250Z
64b63712b3b69063d9aff341
https://cdn-avatars.huggingface.co/v1/production/uploads/64b63712b3b69063d9aff341/nP6GyBKBtnWWoA0TvQF3K.jpeg
John
juyongjiang
user
juyongjiang
698ab6fd1b2dc6b37d61b05c
Zhonghui Jiang
698ab6fd1b2dc6b37d61b05d
Zhenzhong Lan
698ab6fd1b2dc6b37d61b05e
Chengxi Li
698ab6fd1b2dc6b37d61b05f
Jianguo Li
698ab6fd1b2dc6b37d61b060
Zehuan Li
698ab6fd1b2dc6b37d61b061
Huabin Liu
claimed_verified
2026-02-10T09:05:42.985Z
6470600790482b0e0f65a393
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/fOUWWhf9jjsC9fgIiFlPc.png
Huabin
Rookie-Liu
user
Rookie-Liu
698ab6fd1b2dc6b37d61b062
Lin Liu
698ab6fd1b2dc6b37d61b063
Guoshan Lu
698ab6fd1b2dc6b37d61b064
Yuan Lu
698ab6fd1b2dc6b37d61b065
Yuxin Ma
698ab6fd1b2dc6b37d61b066
Xingyu Mou
698ab6fd1b2dc6b37d61b067
Zhenxuan Pan
698ab6fd1b2dc6b37d61b068
Kaida Qiu
698ab6fd1b2dc6b37d61b069
Yuji Ren
claimed_verified
2026-03-09T10:40:39.032Z
69ac1e40e945b55bb8238588
/avatars/0735a44beb23925af26faab7f612ab18.svg
renyuji
renyuji
user
renyuji
698ab6fd1b2dc6b37d61b06a
Jianfeng Tan
698ab6fd1b2dc6b37d61b06b
Yiding Tian
claimed_verified
2026-02-10T09:05:47.064Z
5f94dea4cf95e81b6854e223
https://cdn-avatars.huggingface.co/v1/production/uploads/5f94dea4cf95e81b6854e223/r3VW8rb0wlJ7t_Lcpqi5f.jpeg
Dean Tian
killa1218
user
killa1218
698ab6fd1b2dc6b37d61b06c
Zian Wang
698ab6fd1b2dc6b37d61b06d
Lanning Wei
698ab6fd1b2dc6b37d61b06e
Tao Wu
698ab6fd1b2dc6b37d61b06f
Yipeng Xing
698ab6fd1b2dc6b37d61b070
Wentao Ye
claimed_verified
2026-02-11T11:19:02.750Z
65a97147cb5b4fb08e716afd
/avatars/7ddd4eb85d472cf42f71a3c34d659582.svg
Wentao Ye
darklight03
user
darklight03
698ab6fd1b2dc6b37d61b071
Liangyu Zha
698ab6fd1b2dc6b37d61b072
Tianze Zhang
698ab6fd1b2dc6b37d61b073
Xiaolu Zhang
698ab6fd1b2dc6b37d61b074
Junbo Zhao
claimed_verified
2026-02-10T09:05:45.032Z
6725f5a7f05f62659e3615f3
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/iiXdzhaSnExw2dwQQtLZ8.png
Junbo Zhao
jakezhao2024
user
jakezhao2024
698ab6fd1b2dc6b37d61b075
Da Zheng
698ab6fd1b2dc6b37d61b076
Hao Zhong
698ab6fd1b2dc6b37d61b077
Wanli Zhong
698ab6fd1b2dc6b37d61b078
Jun Zhou
698ab6fd1b2dc6b37d61b079
Junlin Zhou
claimed_verified
2026-02-10T09:05:49.495Z
63eb008e5c837d9968f1eb71
/avatars/ae43c3f5ab87b82f4bad25c65ac55d01.svg
Junlin Zhou
jlzhou
user
jlzhou
698ab6fd1b2dc6b37d61b07a
Liwang Zhu
698ab6fd1b2dc6b37d61b07b
Muzhi Zhu
claimed_verified
2026-02-10T09:05:33.817Z
632179745fc60c44fd91fc33
/avatars/37d4fefbcc19f091dccffefec9706de2.svg
zhumuzhi
Z-MU-Z
user
Z-MU-Z
698ab6fd1b2dc6b37d61b07c
Yihong Zhuang
claimed_verified
2026-02-10T09:05:55.143Z
673b5f24e863f1d28b402efc
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/19gUgtPEY3-FtY0sNlI_-.png
yihongzhuang
utdawn
user
utdawn
LLaDA2.1: Speeding Up Text Diffusion via Token Editing
While LLaDA2.0 showcased the scaling potential of 100B-level block-diffusion models and their inherent parallelization, the delicate equilibrium between decoding speed and generation quality has remained an elusive frontier. Today, we unveil LLaDA2.1, a paradigm shift designed to transcend this trade-off. By seamlessly weaving Token-to-Token (T2T) editing into the conventional Mask-to-Token (M2T) scheme, we introduce a joint, configurable threshold-decoding scheme. This structural innovation gives rise to two distinct personas: the Speedy Mode (S Mode), which audaciously lowers the M2T threshold to bypass traditional constraints while relying on T2T to refine the output; and the Quality Mode (Q Mode), which leans into conservative thresholds to secure superior benchmark performances with manageable efficiency degrade. Furthering this evolution, underpinned by an expansive context window, we implement the first large-scale Reinforcement Learning (RL) framework specifically tailored for dLLMs, anchored by specialized techniques for stable gradient estimation. This alignment not only sharpens reasoning precision but also elevates instruction-following fidelity, bridging the chasm between diffusion dynamics and complex human intent. We culminate this work by releasing LLaDA2.1-Mini (16B) and LLaDA2.1-Flash (100B). Across 33 rigorous benchmarks, LLaDA2.1 delivers strong task performance and lightning-fast decoding speed. Despite its 100B volume, on coding tasks it attains an astounding 892 TPS on HumanEval+, 801 TPS on BigCodeBench, and 663 TPS on LiveCodeBench.
LLaDA2.1 introduces a novel token-to-token editing approach with speed and quality modes, enhanced through reinforcement learning for improved reasoning and instruction following in large language diffusion models.
block-diffusion models decoding speed generation quality Token-to-Token editing Mask-to-Token scheme threshold-decoding scheme Speedy Mode Quality Mode Reinforcement Learning gradient estimation reasoning precision instruction-following large language diffusion models HumanEval+ BigCodeBench LiveCodeBench