Improve model card, add metadata and links

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +32 -1
README.md CHANGED
@@ -1 +1,32 @@
1
- Model weight of [MBD-LMs](https://arxiv.org/abs/2606.29215)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ ---
6
+
7
+ # Multi-Block Diffusion Language Models (MBD-LMs)
8
+
9
+ Model weights of [MBD-LMs](https://arxiv.org/abs/2606.29215).
10
+
11
+ - **Project Page:** [sjtu-deng-lab.github.io/mbd-lms](https://sjtu-deng-lab.github.io/mbd-lms)
12
+ - **GitHub Repository (Training & Configs):** [SJTU-DENG-Lab/mbd-lms](https://github.com/SJTU-DENG-Lab/mbd-lms)
13
+ - **Inference Engine (Diffulex):** [SJTU-DENG-Lab/Diffulex](https://github.com/SJTU-DENG-Lab/Diffulex)
14
+
15
+ ## Introduction
16
+
17
+ Block Diffusion Language Models (BD-LMs) improve diffusion-based text generation with KV caching and flexible-length generation. Multi-Block Diffusion Language Models (MBD-LMs) extend this from Single-Block Diffusion (SingleBD) to Multi-Block Diffusion (MultiBD), where a running-set of consecutive blocks is decoded concurrently for inter-block parallelism.
18
+
19
+ MBD-LMs are obtained by post-training BD-LMs with **Multi-block Teacher Forcing (MultiTF)**, which integrates teacher forcing and diffusion forcing by training on bounded noise-groups conditioned on clean prefixes, matching practical MultiBD inference states.
20
+
21
+ ## Citation
22
+
23
+ If you find this work useful, please cite:
24
+
25
+ ```bibtex
26
+ @article{jin2026multiblock,
27
+ title={Multi-Block Diffusion Language Models},
28
+ author={Jin, Yijie and Xu, Jiajun and Liu, Yuxuan and Xu, Chenkai and Tu, Yi and Li, Jiajun and Tu, Dandan and Yan, Xiaohui and Yu, Kai and Liu, Pengfei and Deng, Zhijie},
29
+ journal={arXiv preprint arXiv:2606.29215},
30
+ year={2026}
31
+ }
32
+ ```