|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
# **ControlNet++: All-in-one ControlNet for image generations and editing!** |
|
 |
|
|
|
## Network Arichitecture |
|
 |
|
|
|
We design a new architecture that can support 10+ control types in condition text-to-image generation and can generate high resolution images visually comparable with |
|
midjourney. The network is based on the original ControlNet architecture, we propose two new modules to: 1 Extend the original ControlNet to support different image |
|
conditions using the same network parameter. 2 Support multiple conditions input without increasing computation offload, which is especially important for designers |
|
who want to edit image in detail, different conditions use the same condition encoder, without adding extra computations or parameters. We do thoroughly experiments |
|
on SDXL and achieve superior performance both in control ability and aesthetic score. We release the method and the model to the open source community to make everyone |
|
can enjoy it. |
|
|
|
More details can found: https://github.com/xinsir6/ControlNetPlus/tree/main |
|
|
|
**If you find it useful, please give me a star, thank you very much** |
|
|
|
|
|
|
|
## Visual Examples |
|
### Openpose |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Depth |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Canny |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Lineart |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### AnimeLineart |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Mlsd |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Scribble |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Hed |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Pidi(Softedge) |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Teed |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Segment |
|
 |
|
 |
|
 |
|
 |
|
 |
|
### Normal |
|
 |
|
 |
|
 |
|
 |
|
 |
