Fast-Decoding Diffusion Language Models via Progress-Aware Confidence Schedules
Diffusion large language models (dLLMs) offer a promising alternative to autoregressive models, but their practical utility is severely hampered by slow, iterative sampling. We present SchED, a training-free, model-agnostic early-exit algorithm that aggregates full-span logit margins and halts decoding once a smooth, progress-dependent confidence threshold is met. We evaluated SchED on two dLLM families (Dream and LLaDA), in base and instruction-tuned variants across ten benchmarks spanning downstream tasks including multiple-choice question answering (MCQ), math, long-form QA/summarization, and translation. SchED delivers large, stable accelerations: on instruction-tuned models, it achieves 3.8-4.0times speedups while retaining 99.8-100% of the baseline score on average. On base models, SchED yields consistent speedup gains with 99.1-100% performance retention, with up to 2.34times under more aggressive settings. Using a conservative speed metric that heavily penalizes quality loss (QPS, γ{=}4), we show that SchED is robust and clearly outperforms prior confidence-based early-exit methods, which break down on long-form generation. An entropy analysis of the model's token predictions reveals that instruction tuning speeds up the decay of predictive entropy. By turning genuine confidence stabilization into computational savings, SchED makes dLLM decoding substantially more efficient.
693a4c4d74fced5bf9c32493
Amr Mohamed
claimed_verified
2025-12-11T10:12:35.890Z
655efd24afee0e00788bb589
https://cdn-avatars.huggingface.co/v1/production/uploads/655efd24afee0e00788bb589/22guLxIWNybbJR3jI-c4w.jpeg
Amr Mohamed
amr-mohamed
user
amr-mohamed
693a4c4d74fced5bf9c32494
Yang Zhang
claimed_verified
2025-12-12T09:16:56.863Z
64f1f92eefacc7da583a9e22
/avatars/18abbf9e31ca916f8d9a4495639a1329.svg
Yang ZHANG
yangzhang33
user
yangzhang33
693a4c4d74fced5bf9c32495
Michalis Vazirgiannis
admin_assigned
2025-12-11T10:48:25.471Z
6839c2d132331eaf76bea940
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/U2daTtJiD-9JYYnbr4Xbu.png
Michalis Vazirgiannis
mvazirg
user
mvazirg
693a4c4d74fced5bf9c32496
Guokan Shang
admin_assigned
2025-12-11T10:48:31.176Z
6087e598e2b7cc3a117b0dc5
https://cdn-avatars.huggingface.co/v1/production/uploads/6087e598e2b7cc3a117b0dc5/Ctz_W-uo1gOQRBHXalD1P.png
Guokan Shang
guokan-shang
user
guokan-shang
Fast-Decoding Diffusion Language Models via Progress-Aware Confidence Schedules
Diffusion large language models (dLLMs) offer a promising alternative to autoregressive models, but their practical utility is severely hampered by slow, iterative sampling. We present SchED, a training-free, model-agnostic early-exit algorithm that aggregates full-span logit margins and halts decoding once a smooth, progress-dependent confidence threshold is met. We evaluated SchED on two dLLM families (Dream and LLaDA), in base and instruction-tuned variants across ten benchmarks spanning downstream tasks including multiple-choice question answering (MCQ), math, long-form QA/summarization, and translation. SchED delivers large, stable accelerations: on instruction-tuned models, it achieves 3.8-4.0times speedups while retaining 99.8-100% of the baseline score on average. On base models, SchED yields consistent speedup gains with 99.1-100% performance retention, with up to 2.34times under more aggressive settings. Using a conservative speed metric that heavily penalizes quality loss (QPS, γ{=}4), we show that SchED is robust and clearly outperforms prior confidence-based early-exit methods, which break down on long-form generation. An entropy analysis of the model's token predictions reveals that instruction tuning speeds up the decay of predictive entropy. By turning genuine confidence stabilization into computational savings, SchED makes dLLM decoding substantially more efficient.
SchED, a training-free early-exit algorithm, accelerates diffusion large language model decoding with minimal performance loss across various tasks.
diffusion large language models dLLMs autoregressive models SchED early-exit algorithm full-span logit margins confidence threshold multiple-choice question answering math long-form QA/summarization translation instruction-tuned models base models QPS entropy analysis predictive entropy