Skip to content
Node packVerifiedExternal
Open source

ComfyUI-AnimateDiff-Evolved

Improved AnimateDiff for ComfyUI and Advanced Sampling Support

Sourcegithub.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved
Maintainer@KosinkadinkBgrade

Package profile

Status
Verified
Publisher
@Kosinkadink
Source
GitHub
Stars
3.6K

README

AnimateDiff for ComfyUI

Improved AnimateDiff integration for ComfyUI, as well as advanced sampling options dubbed Evolved Sampling usable outside of AnimateDiff. Please read the AnimateDiff repo README and Wiki for more information about how it works at its core.

AnimateDiff workflows will often make use of these helpful node packs:

  • ComfyUI-Advanced-ControlNet for making ControlNets work with Context Options and controlling which latents should be affected by the ControlNet inputs. Includes SparseCtrl support. Maintained by me.
  • ComfyUI-VideoHelperSuite for loading videos, combining images into videos, and doing various image/latent operations like appending, splitting, duplicating, selecting, or counting. Actively maintained by AustinMroz and I.
  • comfyui_controlnet_aux for ControlNet preprocessors not present in vanilla ComfyUI. Maintained by Fannovel16.
  • ComfyUI_IPAdapter_plus for IPAdapter support. Maintained by cubiq (matt3o).
  • ComfyUI-KJNodes for miscellaneous nodes including selecting coordinates for animated GLIGEN. Maintained by kijai.
  • ComfyUI_FizzNodes for an alternate way to do prompt-travel functionality with the BatchPromptSchedule node. Maintained by FizzleDorf.

Installation

If using ComfyUI Manager:

  1. Look for AnimateDiff Evolved, and be sure the author is Kosinkadink. Install it. image

If installing manually:

  1. Clone this repo into custom_nodes folder.

Model Setup:

  1. Download motion modules. You will need at least 1. Different modules produce different results.
    • Original models mm_sd_v14, mm_sd_v15, mm_sd_v15_v2, v3_sd15_mm: HuggingFace | Google Drive | CivitAI
    • Stabilized finetunes of mm_sd_v14, mm-Stabilized_mid and mm-Stabilized_high, by manshoety: HuggingFace
    • Finetunes of mm_sd_v15_v2, mm-p_0.5.pth and mm-p_0.75.pth, by manshoety: HuggingFace
    • Higher resolution finetune,temporaldiff-v1-animatediff by CiaraRowles: HuggingFace
    • FP16/safetensor versions of vanilla motion models, hosted by continue-revolution (takes up less storage space, but uses up the same amount of VRAM as ComfyUI loads models in fp16 by default): HuffingFace
  2. Place models in one of these locations (you can rename models if you wish):
    • ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/models
    • ComfyUI/models/animatediff_models
  3. Optionally, you can use Motion LoRAs to influence movement of v2-based motion models like mm_sd_v15_v2.
    • Google Drive | HuggingFace | CivitAI
    • Place Motion LoRAs in one of these locations (you can rename Motion LoRAs if you wish):
      • ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/motion_lora
      • ComfyUI/models/animatediff_motion_lora
  4. Get creative! If it works for normal image generation, it (probably) will work

Nodes in this pack

100 nodes
  • ADE_ADBlockCombo
  • ADE_ADBlockIndiv
  • ADE_AdjustPEFullStretch
  • ADE_AdjustPEManual
  • ADE_AdjustPESweetspotStretch
  • ADE_AdjustWeightAllAdd
  • ADE_AdjustWeightAllMult
  • ADE_AdjustWeightIndivAdd
  • ADE_AdjustWeightIndivAttnAdd
  • ADE_AdjustWeightIndivAttnMult
  • ADE_AdjustWeightIndivMult
  • ADE_AncestralOptions
  • ADE_AnimateDiffCombine
  • ADE_AnimateDiffKeyframe
  • ADE_AnimateDiffLoaderGen1
  • ADE_AnimateDiffLoaderV1Advanced
  • ADE_AnimateDiffLoaderWithContext
  • ADE_AnimateDiffLoRALoader
  • ADE_AnimateDiffModelSettings
  • ADE_AnimateDiffModelSettings_Release
  • ADE_AnimateDiffModelSettingsAdvancedAttnStrengths
  • ADE_AnimateDiffModelSettingsSimple
  • ADE_AnimateDiffSamplingSettings
  • ADE_AnimateDiffSettings
  • ADE_AnimateDiffUniformContextOptions
  • ADE_AnimateDiffUnload
  • ADE_ApplyAnimateDiffModel
  • ADE_ApplyAnimateDiffModelSimple
  • ADE_ApplyAnimateDiffModelWithCameraCtrl
  • ADE_ApplyAnimateDiffModelWithPIA
  • ADE_ApplyAnimateLCMI2VModel
  • ADE_AttachLoraHookToCLIP
  • ADE_AttachLoraHookToConditioning
  • ADE_BatchedContextOptions
  • ADE_CameraCtrlAnimateDiffKeyframe
  • ADE_CameraManualPoseAppend
  • ADE_CameraPoseAdvanced
  • ADE_CameraPoseBasic
  • ADE_CameraPoseCombo
  • ADE_CFGExtrasPAG
  • ADE_CFGExtrasPAGSimple
  • ADE_CFGExtrasRescaleCFG
  • ADE_CFGExtrasRescaleCFGSimple
  • ADE_CombineLoraHooks
  • ADE_CombineLoraHooksEight
  • ADE_CombineLoraHooksFour
  • ADE_ConditionExtraction
  • ADE_ConditioningCombine
  • ADE_ConditioningSetMask
  • ADE_ConditioningSetMaskAndCombine
  • ADE_ConditioningSetUnmaskedAndCombine
  • ADE_ContextExtras_ContextRef
  • ADE_ContextExtras_ContextRef_Keyframe
  • ADE_ContextExtras_ContextRef_KeyframeFromList
  • ADE_ContextExtras_ContextRef_KeyframeInterpolation
  • ADE_ContextExtras_ContextRef_ModeFirst
  • ADE_ContextExtras_ContextRef_ModeIndexes
  • ADE_ContextExtras_ContextRef_ModeSliding
  • ADE_ContextExtras_ContextRef_TuneAttn
  • ADE_ContextExtras_ContextRef_TuneAttnAdain
  • ADE_ContextExtras_NaiveReuse
  • ADE_ContextExtras_NaiveReuse_Keyframe
  • ADE_ContextExtras_NaiveReuse_KeyframeFromList
  • ADE_ContextExtras_NaiveReuse_KeyframeInterpolation
  • ADE_ContextExtras_Set
  • ADE_CustomCFG
  • ADE_CustomCFGKeyframe
  • ADE_CustomCFGKeyframeFromList
  • ADE_CustomCFGKeyframeInterpolation
  • ADE_CustomCFGKeyframeSimple
  • ADE_CustomCFGSimple
  • ADE_EmptyLatentImageLarge
  • ADE_FloatToFloats
  • ADE_InjectI2VIntoAnimateDiffModel
  • ADE_InjectPIAIntoAnimateDiffModel
  • ADE_InputPIA_Multival
  • ADE_InputPIA_PaperPresets
  • ADE_IterationOptsDefault
  • ADE_IterationOptsFreeInit
  • ADE_LoadAnimateDiffModel
  • ADE_LoadAnimateDiffModelWithCameraCtrl
  • ADE_LoadAnimateLCMI2VModel
  • ADE_LoadCameraPoses
  • ADE_LoadCameraPosesFromPath
  • ADE_LoopedUniformContextOptions
  • ADE_LoopedUniformViewOptions
  • ADE_LoraHookKeyframe
  • ADE_LoraHookKeyframeFromStrengthList
  • ADE_LoraHookKeyframeInterpolation
  • ADE_MultivalConvertToMask
  • ADE_MultivalDynamic
  • ADE_MultivalDynamicFloatInput
  • ADE_MultivalDynamicFloats
  • ADE_MultivalScaledMask
  • ADE_NoisedImageInjection
  • ADE_NoisedImageInjectOptions
  • ADE_NoiseLayerAdd
  • ADE_NoiseLayerAddWeighted
  • ADE_NoiseLayerNormalizedSum
  • ADE_NoiseLayerReplace

Related resources

6 connections
Used byCamera Control - Wan2.1-Fun-V1.1-Control-Camera — v1.0Used byFun+control+camera stable optimization accelerated version mirror movement and main body displacement video guidance V1 — v1.0Used bySimple LCM img2vid workflow | ComfyUI — v4Used byAnimatediff3 img2vid Sparse Control — v1.0Used byConsistent AI Portrait Animator (AnimateDiff + IPAdapter Plus) — v1.0Used by4 or 9 steps, Sampler chains & noise types chains - Flux, Mochi, PDXL, MoGe, LTXV, Others — 🦄🖼>ltx📹

Sources

3 sources
GitHubSource
github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

Verified Oct 9

Comfy registrySource
raw.githubusercontent.com/Comfy-Org/ComfyUI-Manager/main/extension-node-map.json

Verified Oct 14

GitHubSourceVersion 9257651221002dcba0a12f9cff37e1944e58fb60
github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

Verified Oct 14

Source excerpts

1 excerpt
NoteJul 16github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved

Source context: Repo Kosinkadink/ComfyUI-AnimateDiff-Evolved