Pai Diffusion Artist Large Zh ControlNet Canny
我们开源了一个中文 ControlNet 模型,该模型适配 diffusion 模型 alibaba-pai/pai-diffusion-artist-large-zh,您可以使用该模型控制 diffusion 模型生成的图像。
Model source
- Kind
- ControlNet
- File size
- 1.35 GB
- Version
- vdiffusion_pytorch_model
- Updated
- Oct 7, 2026
- Downloads
- 4
- Source
- Hugging Face
Source description
Chinese ControlNet Model (Canny)
简介 Brief Introduction
我们开源了一个中文 ControlNet 模型,该模型适配 diffusion 模型 alibaba-pai/pai-diffusion-artist-large-zh,您可以使用该模型控制 diffusion 模型生成的图像。
We release a Chinese ControlNet model, which works with diffusion model alibaba-pai/pai-diffusion-artist-large-zh. You can use this model to control the diffusion model generating images as you wish.
- Github: EasyNLP
使用 Usage
from diffusers import StableDiffusionControlNetPipeline, ControlNetModel
from transformers import pipeline
from PIL import Image
import numpy as np
import cv2
def to_canny(image):
low_threshold = 100
high_threshold = 200
image = np.array(image)
image = cv2.Canny(image, low_threshold, high_threshold)
image = image[:, :, None]
image = np.concatenate([image, image, image], axis=2)
image = Image.fromarray(image)
return image
controlnet_id = "alibaba-pai/pai-diffusion-artist-large-zh-controlnet-canny"
controlnet = ControlNetModel.from_pretrained(controlnet_id)
model_id = "alibaba-pai/pai-diffusion-artist-large-zh"
pipe = StableDiffusionControlNetPipeline.from_pretrained(model_id, controlnet=controlnet)
pipe = pipe.to("cuda")
image = Image.open("image.png")
controlnet_image = to_canny(image)
prompt = "白色的小鸟"
image = pipe(prompt, controlnet_image).images[0]
controlnet_image.save("image_canny.png")
image.save("image_canny_output.png")
样例 Example
Prompt: "白色的小鸟"
| 原图 | Canny 图 | 生成图 |
|---|---|---|
使用须知 Notice for Use
使用上述模型需遵守AIGC模型开源特别条款。
If you want to use this model, please read this document carefully and abide by the terms.
Sources
1 source
Sources
1 sourceVerified Oct 7
Model artifacts
1 artifact
Model artifacts
1 artifactSource excerpts
3 excerpts
Source excerpts
3 excerpts--- license: apache-2.0 tags: - pytorch - diffusers - text-to-image --- # Chinese ControlNet Model (Canny) ## 简介 Brief Introduction 我们开源了一个中文 ControlNet 模型，该模型适配 diffusion 模型 `alibaba-pai/pai-diffusion-artist-large-zh`，您可以使用该模型控制 diffusion 模型生成的图像。 We release a Chinese ControlNet model, which works with diffusion model `alibaba-pai/pai-diffusion-artist-large-zh`. You can use this model to control the diffusion model generating images as you wish. * Github: [EasyNLP](https://github.com/alibaba/EasyNLP) ## 使用 Usage ```python from diffusers import StableDiffusionControlNetPipeline, ControlNetModel from transformers import pipeline from PIL import Image import numpy as np import cv2 def to_canny(image): low_threshold = 100 high_threshold = 200 image = np.array(image) image = cv2.Canny(image, low_threshold, high_threshold) image = image[:, :, None] image = np.concatenate([image, image, image], axis=2) image = Image.fromarray(image) return image controlnet_id = "alibaba-pai/pai-diffusion-artist-large-zh-controlnet-canny" controlnet = ControlNetModel.from_pretrained(controlnet_id) model_id = "alibaba-pai/pai-diffusion-artist-large-zh" pipe = StableDiffusionControlNetPipeline.from_pretrained(model_id, controlnet=controlnet) pipe = pipe.to("cuda") image = Image.open("image.png") controlnet_image = to_canny(image) prompt = "白色的小鸟" image = pipe(prompt, controlnet_image).images[0] controlnet_image.save("image_canny.png") image.save("image_canny_output.png") ``` ## 样例 Example Prompt: "白色的小鸟" |原图|Canny 图|生成图| |-|-|-| |||| ## 使用须知 Notice for Use 使用上述模型需遵守[AIGC模型开源特别条款](https://terms.alicdn.com/legal-agreement/terms/common_platform_service/20230505180457947/20230505180457947.html)。 If you want to use this model, please read this [document](https://terms.alicdn.com/legal-agreement/terms/common_platform_service/20230505180457947/20230505180457947.html) carefully and abide by the terms.
Source context: 4 downloads · 1 likes · Pipeline text-to-image · Library diffusers · Repo alibaba-pai/pai-diffusion-artist-large-zh-controlnet-canny
Source context: 1 downloads · 1 likes · Pipeline text-to-image · Library diffusers · Repo alibaba-pai/pai-diffusion-artist-large-zh-controlnet-canny
