Causal-Forcing: Real‑Time Single‑Frame Generation on RTX 4090
Check the Causal‑Forcing repo and pull the ComfyUI PR to test KV cache‑accelerated single‑frame generation on an RTX 4090.
Check the Causal‑Forcing repo, pull the ComfyUI PR, and test KV cache on your RTX 4090.
Summary
Causal‑Forcing, a new model from thu‑ml, is designed to generate a single frame at a time and claims real‑time performance on an RTX 4090, though the maximum resolution is not specified.
The model is integrated into ComfyUI via the ar_model.py file, and a pull request (PR #13082) adds this support to the main repository. The integration introduces a KV cache that can accelerate inference, a feature highlighted in the Reddit post.
Developers can access the source code on GitHub at https://github.com/thu-ml/Causal-Forcing and the ComfyUI implementation at https://github.com/Comfy-Org/ComfyUI/blob/master/comfy/ldm/wan/ar_model.py. The project is still in early stages, so performance benchmarks and resolution limits are pending further testing.
Key changes
- Causal‑Forcing supports single‑frame generation
- Real‑time inference on RTX 4090 (resolution unspecified)
- KV cache added for faster generation
- Integration into ComfyUI via ar_model.py
- PR #13082 implements the integration
- GitHub repo at thu‑ml/Causal‑Forcing
- ComfyUI implementation at Comfy‑Org/ComfyUI
- Potential for real‑time applications