ViFeEdit: A Video-Free Tuner of Your Video Diffusion Transformer
Diffusion Transformers (DiTs) have demonstrated remarkable scalability and quality in image and video generation, prompting growing interest in extending them to controllable generation and editing tasks. However, compared to the image counterparts, progress in video control and editing remains limited, mainly due to the scarcity of paired video data and the high computational cost of training video diffusion models. To address this issue, in this paper, we propose a video-free tuning framework termed ViFeEdit for video diffusion transformers. Without requiring any forms of video training data, ViFeEdit achieves versatile video generation and editing, adapted solely with 2D images. At the core of our approach is an architectural reparameterization that decouples spatial independence from the full 3D attention in modern video diffusion transformers, which enables visually faithful editing while maintaining temporal consistency with only minimal additional parameters. Moreover, this design operates in a dual-path pipeline with separate timestep embeddings for noise scheduling, exhibiting strong adaptability to diverse conditioning signals. Extensive experiments demonstrate that our method delivers promising results of controllable video generation and editing with only minimal training on 2D image data. Codes are available https://github.com/Lexie-YU/ViFeEdit.
69b8c4b76b3f36c249fbc3e5
Ruonan Yu
admin_assigned
2026-03-17T08:41:05.993Z
6486fb33570a419f41a882e4
/avatars/860a42074439a23c629cd23851ae4da6.svg
Ruonan Yu
roseannelexie
user
roseannelexie
69b8c4b76b3f36c249fbc3e6
Zhenxiong Tan
admin_assigned
2026-03-17T08:41:14.469Z
640ebdfefdeaae139086f4d8
https://cdn-avatars.huggingface.co/v1/production/uploads/640ebdfefdeaae139086f4d8/2N94gbHubplYD8njmUTPf.jpeg
Zhenxiong Tan
Yuanshi
user
Yuanshi
69b8c4b76b3f36c249fbc3e7
Zigeng Chen
admin_assigned
2026-03-17T08:41:21.088Z
65811eeaa2284a018e51f1ba
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/dH8UZj6Kk5HJkI1DItCNm.jpeg
Zigeng Chen
Zigeng
user
Zigeng
69b8c4b76b3f36c249fbc3e8
Songhua Liu
claimed_verified
2026-03-17T09:37:45.858Z
64b929308b53fb5dbd059ce3
/avatars/564c44cf45db794747a96f79f30ecd91.svg
Liu Songhua
Huage001
user
Huage001
69b8c4b76b3f36c249fbc3e9
Xinchao Wang
ViFeEdit: A Video-Free Tuner of Your Video Diffusion Transformer
Diffusion Transformers (DiTs) have demonstrated remarkable scalability and quality in image and video generation, prompting growing interest in extending them to controllable generation and editing tasks. However, compared to the image counterparts, progress in video control and editing remains limited, mainly due to the scarcity of paired video data and the high computational cost of training video diffusion models. To address this issue, in this paper, we propose a video-free tuning framework termed ViFeEdit for video diffusion transformers. Without requiring any forms of video training data, ViFeEdit achieves versatile video generation and editing, adapted solely with 2D images. At the core of our approach is an architectural reparameterization that decouples spatial independence from the full 3D attention in modern video diffusion transformers, which enables visually faithful editing while maintaining temporal consistency with only minimal additional parameters. Moreover, this design operates in a dual-path pipeline with separate timestep embeddings for noise scheduling, exhibiting strong adaptability to diverse conditioning signals. Extensive experiments demonstrate that our method delivers promising results of controllable video generation and editing with only minimal training on 2D image data. Codes are available https://github.com/Lexie-YU/ViFeEdit.