Have a ComfyUI workflow? Get a readable Workflow Doc in your browser.Make a workflow readable.Try it now ↗
Simple WAN T2V Workflow for Self Forcing
Runtime profile
Source description
Simple WAN T2V Workflow for Self Forcing
Self Forcing trains autoregressive video diffusion models by simulating the inference process during training, performing autoregressive rollout with KV caching. It resolves the train-test distribution mismatch and enables real-time, streaming video generation on a single RTX 4090 while matching the quality of state-of-the-art diffusion models.
Update (i2v):
To use Vace, you will need to use a different checkpoint: https://huggingface.co/lym00/Wan2.1-T2V-1.3B-Self-Forcing-VACE/blob/main/Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors
AI-generated commentary
AI-generated explanation based on source and configuration details. Suggestions are clearly labeled.
This workflow is for generating video with Self Forcing and the Wan Video 1.3B t2v base model. It supports T2V, I2V, and V2V workflows, using text, images, or video as inputs and producing video.
Self Forcing is described as autoregressive rollout with KV caching that simulates inference during training.
The documented task forms are T2V, I2V, and V2V, with video as the output.
Find it on Civitai at https://civitai.com/models/1668005; the listed publisher is Powerpuff.
It requires the `comfyui-videohelpersuite` node pack.
The listed manual model files are `umt5_xxl_fp8_e4m3fn_scaled.safetensors`, `wan_2.1_vae.safetensors`, and `Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors`.
For Vace, use `Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors` as the different checkpoint, and use `self_forcing_dmd.pt` as the T2V checkpoint.
Verify that the three listed model files are available in your setup before using the workflow.
Suggestion · not verified
If you plan to use Vace, verify that the Vace checkpoint and T2V checkpoint match the task you want to run.
Suggestion · not verified
Does this need to be edited?
Sign in to send an edit request.
Sources
1 sourceSource excerpts
1 excerptSource context: 5945 downloads · Type Workflows · Base model Wan Video 1.3B t2v
Download self_forcing_dmd.pt from https://huggingface.co/gdhe17/Self-Forcing/tree/main/checkpoints and use it as the t2v checkpoint.
Project website: https://self-forcing.github.io/
Estimated VRAM requirement
Estimate unavailable
Model file sizes are not complete enough to calculate this requirement yet.
Requirements
4 requirementsumt5_xxl_fp8_e4m3fn_scaled.safetensors
File unverifiedText encoder · SAFETENSORS · Unknown
VAE · Unknown
Wan2.1-T2V-1.3B-Self-Forcing-DMD-VACE-FP16.safetensors
Not resolvedCheckpoint · Unknown
Node pack · Registry
