Skip to content
Node packVerifiedExternal
Open source

ComfyUI-TiledDiffusion

Tiled Diffusion, MultiDiffusion, Mixture of Diffusers, and optimized VAE

Maintainer@shiimizuBgrade

Package profile

Status
Verified
Publisher
@shiimizu
Source
GitHub
Stars
543

README

Tiled Diffusion & VAE for ComfyUI

Check out the SD-WebUI extension for more information.

This extension enables large image drawing & upscaling with limited VRAM via the following techniques:

  • Reproduced SOTA Tiled Diffusion methods
  • pkuliyi2015 & Kahsolt's Tiled VAE algorithm
  • pkuliyi2015 & Kahsolt's TIled Noise Inversion method

[!NOTE]
Sizes/dimensions are in pixels and then converted to latent-space sizes.

Features

  • Supported models
    • SD1.x, SD2.x, SDXL, SD3
    • FLUX
  • ControlNet support
  • StableSR support
  • Tiled Noise Inversion
  • Tiled VAE
  • Regional Prompt Control
  • Img2img upscale
  • Ultra-Large image generation

Tiled Diffusion

[!TIP]

  • Set tile_overlap to 0 and denoise to 1 to see the tile seams and then adjust the options to your needs.
  • Increase tile_batch_size to increase speed (if your machine can handle it).
  • Use the colorfix node if your colors look off.

Options

NameDescription
methodTiling strategy.
tile_widthTile's width
tile_heightTile's height
tile_overlapTile's overlap
tile_batch_sizeThe number of tiles to process in a batch

How can I specify the tiles' arrangement?

If you have the Math Expression node (or something similar), you can use that to pass in the latent that's passed in your KSampler and divide the tile_height/tile_width by the number of rows/columns you want.

C = number of columns you want
R = number of rows you want

pixel width of input image or latent // C = tile_width
pixel height of input image or latent // R = tile_height

SpotDiffusion

Paper

A tiling algorithm that attempts to eliminate seams by randomly shifting the denoise window per timestep. It is mainly used for fast inferences by setting tile_overlap to 0; otherwise, it's better to stick with the other tiling strategies as they produce better outputs.

This additional feature is experimental, in testing, and subject to change.

Tiled VAE

The recommended tile sizes are given upon the creation of the node base

Nodes in this pack

5 nodes
  • NoiseInversion
  • SpotDiffusionParams_TiledDiffusion
  • TiledDiffusion
  • VAEDecodeTiled_TiledDiffusion
  • VAEEncodeTiled_TiledDiffusion

Related resources

11 connections

Sources

3 sources
GitHubSourceVersion a155b1bac39147381aeaa52b9be42e545626a44f
github.com/shiimizu/ComfyUI-TiledDiffusion

Verified Oct 21

Source excerpts

1 excerpt

Source context: Repo shiimizu/ComfyUI-TiledDiffusion