SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing model
SkyReels V4 is a unified multi modal video foundation model for joint video audio generation, inpainting, and editing. The model adopts a dual stream Multimodal Diffusion Transformer (MMDiT) architecture, where one branch synthesizes video and the other generates temporally aligned audio, while sharing a powerful text encoder based on the Multimodal Large Language Models (MMLM). SkyReels V4 accepts rich multi modal instructions, including text, images, video clips, masks, and audio references. By combining the MMLMs multi modal instruction following capability with in context learning in the video branch MMDiT, the model can inject fine grained visual guidance under complex conditioning, while the audio branch MMDiT simultaneously leverages audio references to guide sound generation. On the video side, we adopt a channel concatenation formulation that unifies a wide range of inpainting style tasks, such as image to video, video extension, and video editing under a single interface, and naturally extends to vision referenced inpainting and editing via multi modal prompts. SkyReels V4 supports up to 1080p resolution, 32 FPS, and 15 second duration, enabling high fidelity, multi shot, cinema level video generation with synchronized audio. To make such high resolution, long-duration generation computationally feasible, we introduce an efficiency strategy: Joint generation of low resolution full sequences and high-resolution keyframes, followed by dedicated super-resolution and frame interpolation models. To our knowledge, SkyReels V4 is the first video foundation model that simultaneously supports multi-modal input, joint video audio generation, and a unified treatment of generation, inpainting, and editing, while maintaining strong efficiency and quality at cinematic resolutions and durations.
699fba56ebfce7fbcca91b1a
Guibin Chen
699fba56ebfce7fbcca91b1b
Dixuan Lin
699fba56ebfce7fbcca91b1c
Jiangping Yang
699fba56ebfce7fbcca91b1d
Youqiang Zhang
699fba56ebfce7fbcca91b1e
Zhengcong Fei
699fba56ebfce7fbcca91b1f
Debang Li
699fba56ebfce7fbcca91b20
Sheng Chen
699fba56ebfce7fbcca91b21
Chaofeng Ao
699fba56ebfce7fbcca91b22
Nuo Pang
699fba56ebfce7fbcca91b23
Yiming Wang
699fba56ebfce7fbcca91b24
Yikun Dou
699fba56ebfce7fbcca91b25
Zheng Chen
699fba56ebfce7fbcca91b26
Mingyuan Fan
699fba56ebfce7fbcca91b27
Tuanhui Li
699fba56ebfce7fbcca91b28
Mingshan Chang
699fba56ebfce7fbcca91b29
Hao Zhang
699fba56ebfce7fbcca91b2a
Xiaopeng Sun
claimed_verified
2026-04-03T09:09:33.715Z
644e5e8d67c9458c912d53f8
/avatars/a90007d0b0bd45d762f6b430192b374c.svg
Sun
Xiaopro
user
Xiaopro
699fba56ebfce7fbcca91b2b
Jingtao Xu
699fba56ebfce7fbcca91b2c
Yuqiang Xie
699fba56ebfce7fbcca91b2d
Jiahua Wang
699fba56ebfce7fbcca91b2e
Zhiheng Xu
699fba56ebfce7fbcca91b2f
Weiming Xiong
699fba56ebfce7fbcca91b30
Yuzhe Jin
699fba56ebfce7fbcca91b31
Baoxuan Gu
699fba56ebfce7fbcca91b32
Binjie Mao
699fba56ebfce7fbcca91b33
Yunjie Yu
699fba56ebfce7fbcca91b34
Jujie He
699fba56ebfce7fbcca91b35
Yuhao Feng
699fba56ebfce7fbcca91b36
Shiwen Tu
699fba56ebfce7fbcca91b37
Chaojie Wang
699fba56ebfce7fbcca91b38
Rui Yan
699fba56ebfce7fbcca91b39
Wei Shen
699fba56ebfce7fbcca91b3a
Jingchen Wu
699fba56ebfce7fbcca91b3b
Peng Zhao
699fba56ebfce7fbcca91b3c
Xuanyue Zhong
699fba56ebfce7fbcca91b3d
Zhuangzhuang Liu
699fba56ebfce7fbcca91b3e
Kaifei Wang
699fba56ebfce7fbcca91b3f
Fuxiang Zhang
699fba56ebfce7fbcca91b40
Weikai Xu
699fba56ebfce7fbcca91b41
Wenyan Liu
699fba56ebfce7fbcca91b42
Binglu Zhang
699fba56ebfce7fbcca91b43
Yu Shen
699fba56ebfce7fbcca91b44
Tianhui Xiong
699fba56ebfce7fbcca91b45
Bin Peng
699fba56ebfce7fbcca91b46
Liang Zeng
claimed_verified
2026-02-27T16:43:21.857Z
6621efe1a6eec3ad03e38759
/avatars/c35acce69f244ec0833dffd53eedf6a3.svg
Liang Zeng
zengliangcs
user
zengliangcs
699fba56ebfce7fbcca91b47
Xuchen Song
699fba56ebfce7fbcca91b48
Haoxiang Guo
699fba56ebfce7fbcca91b49
Peiyu Wang
claimed_verified
2026-03-02T09:39:31.601Z
620f5a1c3f76c50e6458a9b6
https://cdn-avatars.huggingface.co/v1/production/uploads/620f5a1c3f76c50e6458a9b6/pXh_f5F0UvufxuUa-eS-v.jpeg
Peiyu Wang
OrlandoHugBot
user
OrlandoHugBot
699fba56ebfce7fbcca91b4a
Yahui Zhou
SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing model
SkyReels V4 is a unified multi modal video foundation model for joint video audio generation, inpainting, and editing. The model adopts a dual stream Multimodal Diffusion Transformer (MMDiT) architecture, where one branch synthesizes video and the other generates temporally aligned audio, while sharing a powerful text encoder based on the Multimodal Large Language Models (MMLM). SkyReels V4 accepts rich multi modal instructions, including text, images, video clips, masks, and audio references. By combining the MMLMs multi modal instruction following capability with in context learning in the video branch MMDiT, the model can inject fine grained visual guidance under complex conditioning, while the audio branch MMDiT simultaneously leverages audio references to guide sound generation. On the video side, we adopt a channel concatenation formulation that unifies a wide range of inpainting style tasks, such as image to video, video extension, and video editing under a single interface, and naturally extends to vision referenced inpainting and editing via multi modal prompts. SkyReels V4 supports up to 1080p resolution, 32 FPS, and 15 second duration, enabling high fidelity, multi shot, cinema level video generation with synchronized audio. To make such high resolution, long-duration generation computationally feasible, we introduce an efficiency strategy: Joint generation of low resolution full sequences and high-resolution keyframes, followed by dedicated super-resolution and frame interpolation models. To our knowledge, SkyReels V4 is the first video foundation model that simultaneously supports multi-modal input, joint video audio generation, and a unified treatment of generation, inpainting, and editing, while maintaining strong efficiency and quality at cinematic resolutions and durations.
SkyReels V4 is a unified multimodal video foundation model that generates, edits, and inpaints video and audio simultaneously using a dual-stream architecture with shared text encoding and efficient high-resolution processing.
Multimodal Diffusion Transformer MMDiT Multimodal Large Language Models MMLM video audio generation video inpainting video editing channel concatenation formulation joint generation super-resolution frame interpolation