ModelListedExternal

IDM VTON

This is an official implementation of paper 'Improving Diffusion Models for Authentic Virtual Try-on in the Wild' paper project page

Sourcehuggingface.co/yisol/IDM-VTON/tree/585a32e74aee241cbc0d0cc3ab21392ca58c916a

KindOtherBase modelstable-diffusion-xl-1.0-inpainting-0.1VersionRevision 585a32eBgrade

Model source

Kind: Other
File size: 200 MB–11.1 GB
Base model: stable-diffusion-xl-1.0-inpainting-0.1
Version: vRevision 585a32e
Updated: Oct 19, 2026
Downloads: 34.3K
Source: Hugging Face

Source description

Check out more codes on our github repository!

IDM-VTON : Improving Diffusion Models for Authentic Virtual Try-on in the Wild

This is an official implementation of paper 'Improving Diffusion Models for Authentic Virtual Try-on in the Wild'

🤗 Try our huggingface Demo

teaser teaser2

TODO LIST

demo model
inference code
training code

Acknowledgements

For the demo, GPUs are supported from zerogpu, and auto masking generation codes are based on OOTDiffusion and DCI-VTON.
Parts of the code are based on IP-Adapter.

Citation

@article{choi2024improving,
  title={Improving Diffusion Models for Virtual Try-on},
  author={Choi, Yisol and Kwak, Sangkyung and Lee, Kyungmin and Choi, Hyungwon and Shin, Jinwoo},
  journal={arXiv preprint arXiv:2403.05139},
  year={2024}
}

License

The codes and checkpoints in this repository are under the CC BY-NC-SA 4.0 license.

Sources

1 source

Hugging FacePrimaryVersion 585a32e74aee241cbc0d0cc3ab21392ca58c916a

huggingface.co/yisol/IDM-VTON/tree/585a32e74aee241cbc0d0cc3ab21392ca58c916a

Verified Oct 19

Model artifacts

9 artifacts

humanparsing/parsing_atr.onnx

onnx · 254 MB · SHA-256 04c7d1d070d0…77f4 · Hugging Face

Download

humanparsing/parsing_lip.onnx

onnx · 255 MB · SHA-256 8436e1dae96e…6dbc · Hugging Face

Download

image_encoder/model.safetensors

safetensors · 2.35 GB · SHA-256 6ca9667da1ca…b030 · Hugging Face

Download

openpose/ckpts/body_pose_model.pth

pth · 200 MB · SHA-256 25a948c16078…b746 · Hugging Face

Download

text_encoder_2/model.safetensors

safetensors · 2.59 GB · SHA-256 283bb90f987a…040e · Hugging Face

Download

text_encoder/model.safetensors

safetensors · 469 MB · SHA-256 79f531155c76…b65b · Hugging Face

Download

unet_encoder/diffusion_pytorch_model.safetensors

safetensors · 9.56 GB · SHA-256 357650fbfb3c…710a · Hugging Face

Download

unet/diffusion_pytorch_model.bin

bin · 11.1 GB · SHA-256 046b775cb9bb…a521 · Hugging Face

Download

vae/diffusion_pytorch_model.safetensors

safetensors · 319 MB · SHA-256 98a14dc6fe8d…4f88 · Hugging Face

Download

Source excerpts

3 excerpts

ReadmeAug 3huggingface.co/yisol/IDM-VTON

--- base_model: stable-diffusion-xl-1.0-inpainting-0.1 tags: - stable-diffusion-xl - inpainting - virtual try-on license: cc-by-nc-sa-4.0 --- # Check out more codes on our [github repository](https://github.com/yisol/IDM-VTON)! # IDM-VTON : Improving Diffusion Models for Authentic Virtual Try-on in the Wild This is an official implementation of paper 'Improving Diffusion Models for Authentic Virtual Try-on in the Wild' - [paper](https://arxiv.org/abs/2403.05139) - [project page](https://idm-vton.github.io/) 🤗 Try our huggingface [Demo](https://huggingface.co/spaces/yisol/IDM-VTON) ![teaser](assets/teaser.png)  ![teaser2](assets/teaser2.png)  ## TODO LIST - [x] demo model - [x] inference code - [ ] training code ## Acknowledgements For the demo, GPUs are supported from [zerogpu](https://huggingface.co/zero-gpu-explorers), and auto masking generation codes are based on [OOTDiffusion](https://github.com/levihsu/OOTDiffusion) and [DCI-VTON](https://github.com/bcmi/DCI-VTON-Virtual-Try-On). Parts of the code are based on [IP-Adapter](https://github.com/tencent-ailab/IP-Adapter). ## Citation ``` @article{choi2024improving, title={Improving Diffusion Models for Virtual Try-on}, author={Choi, Yisol and Kwak, Sangkyung and Lee, Kyungmin and Choi, Hyungwon and Shin, Jinwoo}, journal={arXiv preprint arXiv:2403.05139}, year={2024} } ``` ## License The codes and checkpoints in this repository are under the [CC BY-NC-SA 4.0 license](https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode).

NoteOct 19huggingface.co/yisol/IDM-VTON

Source context: 34342 downloads · 745 likes · Pipeline image-to-image · Library diffusers · Repo yisol/IDM-VTON

NoteAug 3huggingface.co/yisol/IDM-VTON

Source context: 14018 downloads · 737 likes · Pipeline image-to-image · Library diffusers · Repo yisol/IDM-VTON