DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing
Current unified multimodal models for image generation and editing typically rely on massive parameter scales (e.g., >10B), entailing prohibitive training costs and deployment footprints. In this work, we present DeepGen 1.0, a lightweight 5B unified model that achieves comprehensive capabilities competitive with or surpassing much larger counterparts. To overcome the limitations of compact models in semantic understanding and fine-grained control, we introduce Stacked Channel Bridging (SCB), a deep alignment framework that extracts hierarchical features from multiple VLM layers and fuses them with learnable 'think tokens' to provide the generative backbone with structured, reasoning-rich guidance. We further design a data-centric training strategy spanning three progressive stages: (1) Alignment Pre-training on large-scale image-text pairs and editing triplets to synchronize VLM and DiT representations, (2) Joint Supervised Fine-tuning on a high-quality mixture of generation, editing, and reasoning tasks to foster omni-capabilities, and (3) Reinforcement Learning with MR-GRPO, which leverages a mixture of reward functions and supervision signals, resulting in substantial gains in generation quality and alignment with human preferences, while maintaining stable training progress and avoiding visual artifacts. Despite being trained on only ~50M samples, DeepGen 1.0 achieves leading performance across diverse benchmarks, surpassing the 80B HunyuanImage by 28% on WISE and the 27B Qwen-Image-Edit by 37% on UniREditBench. By open-sourcing our training code, weights, and datasets, we provide an efficient, high-performance alternative to democratize unified multimodal research.
698ea0f9cace060ff123ae3a
Dianyi Wang
claimed_verified
2026-02-23T09:46:52.987Z
66084749d81d611249a18239
/avatars/a7256b4e3b686133aaa481a72e3058de.svg
Alex Wang(SII)
Alex11556666
user
Alex11556666
698ea0f9cace060ff123ae3b
Ruihang Li
698ea0f9cace060ff123ae3c
Feng Han
698ea0f9cace060ff123ae3d
Chaofan Ma
claimed_verified
2026-03-27T11:38:41.605Z
63048965eb6d777a838cb7a8
/avatars/b987fb7f630443bf94a03daf8dcbffe9.svg
chaofanma
chaofanma
user
chaofanma
698ea0f9cace060ff123ae3e
Wei Song
698ea0f9cace060ff123ae3f
Siyuan Wang
698ea0f9cace060ff123ae40
Yibin Wang
claimed_verified
2026-03-16T10:45:41.217Z
654c6845bac6e6e49895a5b5
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/KXQaAxulqr8jNBSpEaYM4.png
SII-Yibin Wang
CodeGoat24
user
CodeGoat24
698ea0f9cace060ff123ae41
Yi Xin
698ea0f9cace060ff123ae42
Hongjian Liu
698ea0f9cace060ff123ae43
Zhixiong Zhang
698ea0f9cace060ff123ae44
Shengyuan Ding
698ea0f9cace060ff123ae45
Tianhang Wang
698ea0f9cace060ff123ae46
Zhenglin Cheng
claimed_verified
2026-04-16T20:22:46.938Z
65028e8389707f182386588c
/avatars/86a748a3264e6e0f4ee5eaf8f7032ecb.svg
Zhenglin Cheng
kenshinn
user
kenshinn
698ea0f9cace060ff123ae47
Tao Lin
698ea0f9cace060ff123ae48
Cheng Jin
698ea0f9cace060ff123ae49
Kaicheng Yu
698ea0f9cace060ff123ae4a
Jingjing Chen
698ea0f9cace060ff123ae4b
Wenjie Wang
698ea0f9cace060ff123ae4c
Zhongyu Wei
698ea0f9cace060ff123ae4d
Jiaqi Wang
claimed_verified
2026-02-17T15:51:06.682Z
64b4eec4faa3181a5eab9c46
/avatars/bcc9bf5cbf67546ad2b4c9ec8b96ac96.svg
Jiaqi Wang
myownskyW7
user
myownskyW7
DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing
Current unified multimodal models for image generation and editing typically rely on massive parameter scales (e.g., >10B), entailing prohibitive training costs and deployment footprints. In this work, we present DeepGen 1.0, a lightweight 5B unified model that achieves comprehensive capabilities competitive with or surpassing much larger counterparts. To overcome the limitations of compact models in semantic understanding and fine-grained control, we introduce Stacked Channel Bridging (SCB), a deep alignment framework that extracts hierarchical features from multiple VLM layers and fuses them with learnable 'think tokens' to provide the generative backbone with structured, reasoning-rich guidance. We further design a data-centric training strategy spanning three progressive stages: (1) Alignment Pre-training on large-scale image-text pairs and editing triplets to synchronize VLM and DiT representations, (2) Joint Supervised Fine-tuning on a high-quality mixture of generation, editing, and reasoning tasks to foster omni-capabilities, and (3) Reinforcement Learning with MR-GRPO, which leverages a mixture of reward functions and supervision signals, resulting in substantial gains in generation quality and alignment with human preferences, while maintaining stable training progress and avoiding visual artifacts. Despite being trained on only ~50M samples, DeepGen 1.0 achieves leading performance across diverse benchmarks, surpassing the 80B HunyuanImage by 28% on WISE and the 27B Qwen-Image-Edit by 37% on UniREditBench. By open-sourcing our training code, weights, and datasets, we provide an efficient, high-performance alternative to democratize unified multimodal research.
A lightweight 5B unified multimodal model achieves competitive performance through hierarchical feature extraction, learnable think tokens, and progressive training strategies including alignment pre-training, joint supervised fine-tuning, and reinforcement learning with MR-GRPO.
unified multimodal models image generation image editing parameter scale VLM layers DiT representations Stacked Channel Bridging think tokens data-centric training strategy alignment pre-training joint supervised fine-tuning reinforcement learning MR-GRPO generation quality human preferences visual artifacts