Salt: Self-Consistent Distribution Matching with Cache-Aware Training for Fast Video Generation
Distilling video generation models to extremely low inference budgets (e.g., 2--4 NFEs) is crucial for real-time deployment, yet remains challenging. Trajectory-style consistency distillation often becomes conservative under complex video dynamics, yielding an over-smoothed appearance and weak motion. Distribution matching distillation (DMD) can recover sharp, mode-seeking samples, but its local training signals do not explicitly regularize how denoising updates compose across timesteps, making composed rollouts prone to drift. To overcome this challenge, we propose Self-Consistent Distribution Matching Distillation (SC-DMD), which explicitly regularizes the endpoint-consistent composition of consecutive denoising updates. For real-time autoregressive video generation, we further treat the KV cache as a quality parameterized condition and propose Cache-Distribution-Aware training. This training scheme applies SC-DMD over multi-step rollouts and introduces a cache-conditioned feature alignment objective that steers low-quality outputs toward high-quality references. Across extensive experiments on both non-autoregressive backbones (e.g., Wan~2.1) and autoregressive real-time paradigms (e.g., Self Forcing), our method, dubbed Salt, consistently improves low-NFE video generation quality while remaining compatible with diverse KV-cache memory mechanisms. Source code will be released at https://github.com/XingtongGe/Salt{https://github.com/XingtongGe/Salt}.
69d3d22b2c523d36431fae9c
Xingtong Ge
claimed_verified
2026-04-07T08:37:51.669Z
65a94d2bbe0b2002351b6a8e
/avatars/c2a7a4bff254c643c1158a20dd74dc0f.svg
Xingtong Ge
domiso
user
domiso
69d3d22b2c523d36431fae9d
Yi Zhang
69d3d22b2c523d36431fae9e
Yushi Huang
69d3d22b2c523d36431fae9f
Dailan He
69d3d22b2c523d36431faea0
Xiahong Wang
69d3d22b2c523d36431faea1
Bingqi Ma
69d3d22b2c523d36431faea2
Guanglu Song
69d3d22b2c523d36431faea3
Yu Liu
69d3d22b2c523d36431faea4
Jun Zhang
Salt: Self-Consistent Distribution Matching with Cache-Aware Training for Fast Video Generation
Distilling video generation models to extremely low inference budgets (e.g., 2--4 NFEs) is crucial for real-time deployment, yet remains challenging. Trajectory-style consistency distillation often becomes conservative under complex video dynamics, yielding an over-smoothed appearance and weak motion. Distribution matching distillation (DMD) can recover sharp, mode-seeking samples, but its local training signals do not explicitly regularize how denoising updates compose across timesteps, making composed rollouts prone to drift. To overcome this challenge, we propose Self-Consistent Distribution Matching Distillation (SC-DMD), which explicitly regularizes the endpoint-consistent composition of consecutive denoising updates. For real-time autoregressive video generation, we further treat the KV cache as a quality parameterized condition and propose Cache-Distribution-Aware training. This training scheme applies SC-DMD over multi-step rollouts and introduces a cache-conditioned feature alignment objective that steers low-quality outputs toward high-quality references. Across extensive experiments on both non-autoregressive backbones (e.g., Wan~2.1) and autoregressive real-time paradigms (e.g., Self Forcing), our method, dubbed Salt, consistently improves low-NFE video generation quality while remaining compatible with diverse KV-cache memory mechanisms. Source code will be released at https://github.com/XingtongGe/Salt{https://github.com/XingtongGe/Salt}.
Video generation models are distilled using self-consistent distribution matching to improve quality under extreme inference constraints, with cache-aware training enhancing real-time autoregressive generation.
trajectory-style consistency distillation distribution matching distillation denoising updates compositional rollouts self-consistent distribution matching distillation cache-conditioned feature alignment autoregressive video generation KV cache real-time deployment