DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning
While large-scale diffusion models have revolutionized video synthesis, achieving precise control over both multi-subject identity and multi-granularity motion remains a significant challenge. Recent attempts to bridge this gap often suffer from limited motion granularity, control ambiguity, and identity degradation, leading to suboptimal performance on identity preservation and motion control. In this work, we present DreamVideo-Omni, a unified framework enabling harmonious multi-subject customization with omni-motion control via a progressive two-stage training paradigm. In the first stage, we integrate comprehensive control signals for joint training, encompassing subject appearances, global motion, local dynamics, and camera movements. To ensure robust and precise controllability, we introduce a condition-aware 3D rotary positional embedding to coordinate heterogeneous inputs and a hierarchical motion injection strategy to enhance global motion guidance. Furthermore, to resolve multi-subject ambiguity, we introduce group and role embeddings to explicitly anchor motion signals to specific identities, effectively disentangling complex scenes into independent controllable instances. In the second stage, to mitigate identity degradation, we design a latent identity reward feedback learning paradigm by training a latent identity reward model upon a pretrained video diffusion backbone. This provides motion-aware identity rewards in the latent space, prioritizing identity preservation aligned with human preferences. Supported by our curated large-scale dataset and the comprehensive DreamOmni Bench for multi-subject and omni-motion control evaluation, DreamVideo-Omni demonstrates superior performance in generating high-quality videos with precise controllability.
69b374e62ad6c5d4cf486a2b
Yujie Wei
admin_assigned
2026-03-13T08:50:26.588Z
637f70d6fab5db9101c3dfc8
https://cdn-avatars.huggingface.co/v1/production/uploads/637f70d6fab5db9101c3dfc8/NgkYNXWLDavLbrnCby2Fl.jpeg
Yujie Wei
weilllllls
user
weilllllls
69b374e62ad6c5d4cf486a2c
Xinyu Liu
69b374e62ad6c5d4cf486a2d
Shiwei Zhang
69b374e62ad6c5d4cf486a2e
Hangjie Yuan
admin_assigned
2026-03-13T08:50:42.360Z
649d54b314afbb10ce2a9eeb
/avatars/15c325d8c2273ff63569f23015e98486.svg
Hangjie Yuan
JacobYuan
user
JacobYuan
69b374e62ad6c5d4cf486a2f
Jinbo Xing
admin_assigned
2026-03-13T08:50:51.446Z
64770e86d7cf39f2e937ae9a
https://cdn-avatars.huggingface.co/v1/production/uploads/64770e86d7cf39f2e937ae9a/pLqGg2z1KzQxCGpMwds-9.jpeg
Jinbo Xing
Doubiiu
user
Doubiiu
69b374e62ad6c5d4cf486a30
Zhekai Chen
admin_assigned
2026-03-13T08:50:57.468Z
62d812e143df7719860d05d1
/avatars/412f7ec5c9f54990f4b562652d3e2c59.svg
zhekai chen
Azily
user
Azily
69b374e62ad6c5d4cf486a31
Xiang Wang
69b374e62ad6c5d4cf486a32
Haonan Qiu
admin_assigned
2026-03-13T08:51:03.732Z
63023b6ab002e9a4a2152890
/avatars/cae8ba0a8d61fb4e576934431f43991b.svg
Haonan Qiu
MoonQiu
user
MoonQiu
69b374e62ad6c5d4cf486a33
Rui Zhao
69b374e62ad6c5d4cf486a34
Yutong Feng
admin_assigned
2026-03-13T08:51:11.352Z
64a54e468cfaa458bd6844bf
https://cdn-avatars.huggingface.co/v1/production/uploads/64a54e468cfaa458bd6844bf/5Gmf4tAr59GNl-2VaZDbu.png
Yutong Feng
fengyutong
user
fengyutong
69b374e62ad6c5d4cf486a35
Ruihang Chu
admin_assigned
2026-03-13T08:51:20.652Z
642e3bcb958faf258a40e89c
/avatars/dad142df2217f8eed1f45c9e7287d3ea.svg
Ruihang Chu
Ruihang
user
Ruihang
69b374e62ad6c5d4cf486a36
Yingya Zhang
69b374e62ad6c5d4cf486a37
Yike Guo
admin_assigned
2026-03-13T08:51:30.909Z
64762b325f70f9b2d0ade28e
/avatars/1f37382724b475ece805f943a8858acd.svg
Yike Guo
SuaLily
user
SuaLily
69b374e62ad6c5d4cf486a38
Xihui Liu
69b374e62ad6c5d4cf486a39
Hongming Shan
admin_assigned
2026-03-13T08:51:37.593Z
691ef516948f1328f84f8fef
/avatars/9aa707847870b4337f71b930a065dce8.svg
Hongming Shan
hmshan
user
hmshan
DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning
While large-scale diffusion models have revolutionized video synthesis, achieving precise control over both multi-subject identity and multi-granularity motion remains a significant challenge. Recent attempts to bridge this gap often suffer from limited motion granularity, control ambiguity, and identity degradation, leading to suboptimal performance on identity preservation and motion control. In this work, we present DreamVideo-Omni, a unified framework enabling harmonious multi-subject customization with omni-motion control via a progressive two-stage training paradigm. In the first stage, we integrate comprehensive control signals for joint training, encompassing subject appearances, global motion, local dynamics, and camera movements. To ensure robust and precise controllability, we introduce a condition-aware 3D rotary positional embedding to coordinate heterogeneous inputs and a hierarchical motion injection strategy to enhance global motion guidance. Furthermore, to resolve multi-subject ambiguity, we introduce group and role embeddings to explicitly anchor motion signals to specific identities, effectively disentangling complex scenes into independent controllable instances. In the second stage, to mitigate identity degradation, we design a latent identity reward feedback learning paradigm by training a latent identity reward model upon a pretrained video diffusion backbone. This provides motion-aware identity rewards in the latent space, prioritizing identity preservation aligned with human preferences. Supported by our curated large-scale dataset and the comprehensive DreamOmni Bench for multi-subject and omni-motion control evaluation, DreamVideo-Omni demonstrates superior performance in generating high-quality videos with precise controllability.
DreamVideo-Omni is a unified framework for video synthesis that enables precise multi-subject identity control and multi-granularity motion manipulation through a two-stage training approach combining condition-aware 3D positional embeddings, hierarchical motion injection, and latent identity reward learning.
diffusion models video synthesis multi-subject customization omni-motion control progressive two-stage training condition-aware 3D rotary positional embedding hierarchical motion injection group and role embeddings latent identity reward feedback learning latent identity reward model video diffusion backbone