Causal Forcing: Improved Autoregressive Diffusion Distillation for Real‑Time Video Generation
Apply Causal Forcing to your autoregressive diffusion pipeline to boost visual quality and motion dynamics while keeping training and inference costs unchanged.
Fine‑tune your base model with Causal Forcing and benchmark against Self Forcing on a 4090 to validate performance gains.
Summary
Causal Forcing is a new training strategy for autoregressive diffusion distillation that outperforms Self Forcing in visual quality and motion dynamics.
It addresses a theoretical flaw in Self Forcing’s ODE initialization, where a bidirectional teacher supervises an autoregressive student, violating frame‑level injectivity. The method first fine‑tunes a bidirectional base model into an autoregressive diffusion model, then uses it as the teacher for ODE initialization, followed by the same DMD stage as Self Forcing.
The resulting model delivers real‑time, streaming video generation on a single RTX 4090 without increasing training budget or inference cost. Visual quality improvements are evident in sharper frames, while motion dynamics show smoother transitions between frames.
The technique is documented on the project site and released on HuggingFace under the name zhuhz22/Causal‑Forcing. Researchers and practitioners can adopt Causal Forcing to boost the performance of their real‑time video generation pipelines.
Key changes
- Fine‑tunes bidirectional base model into autoregressive diffusion teacher
- Fixes ODE initialization flaw violating frame‑level injectivity
- Improves visual quality and motion dynamics
- Maintains same training budget and inference efficiency
- Enables real‑time streaming on a single RTX 4090
- Uses DMD stage similar to Self Forcing
- Available on HuggingFace as zhuhz22/Causal‑Forcing
- Documented on project site