Update README.md
Browse files
README.md
CHANGED
@@ -5,4 +5,86 @@ license_name: stable-cascade-nc-community
|
|
5 |
license_link: LICENSE
|
6 |
prior:
|
7 |
- Disty0/sotediffusion-wuerstchen3-alpha1
|
8 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
license_link: LICENSE
|
6 |
prior:
|
7 |
- Disty0/sotediffusion-wuerstchen3-alpha1
|
8 |
+
---
|
9 |
+
|
10 |
+
# SoteDiffusion Cascade
|
11 |
+
|
12 |
+
Anime finetune of Würstchen V3.
|
13 |
+
Currently is in very early state in training.
|
14 |
+
No commercial use thanks to StabilityAI.
|
15 |
+
|
16 |
+
# Usage
|
17 |
+
Please refer to the main model: https://huggingface.co/Disty0/sotediffusion-wuerstchen3-alpha1
|
18 |
+
|
19 |
+
|
20 |
+
## Dataset
|
21 |
+
|
22 |
+
Used the same dataset as Disty0/sote-diffusion-cascade-decoder-alpha0.
|
23 |
+
Changed the training parameters.
|
24 |
+
Trained with 98K~ images.
|
25 |
+
|
26 |
+
## Training:
|
27 |
+
|
28 |
+
**GPU used for training**: 1x AMD RX 7900 XTX 24GB
|
29 |
+
|
30 |
+
**Software used**: https://github.com/2kpr/StableCascade
|
31 |
+
|
32 |
+
### Config:
|
33 |
+
```
|
34 |
+
experiment_id: sotediffusion-sc-b_3b
|
35 |
+
model_version: 3B
|
36 |
+
dtype: bfloat16
|
37 |
+
use_fsdp: False
|
38 |
+
|
39 |
+
batch_size: 16
|
40 |
+
grad_accum_steps: 16
|
41 |
+
updates: 6125
|
42 |
+
backup_every: 512
|
43 |
+
save_every: 256
|
44 |
+
warmup_updates: 100
|
45 |
+
|
46 |
+
lr: 1.0e-5
|
47 |
+
optimizer_type: Adafactor
|
48 |
+
adaptive_loss_weight: False
|
49 |
+
stochastic_rounding: True
|
50 |
+
|
51 |
+
image_size: 768
|
52 |
+
multi_aspect_ratio: [1/1, 1/2, 1/3, 2/3, 3/4, 1/5, 2/5, 3/5, 4/5, 1/6, 5/6, 9/16]
|
53 |
+
shift: 4
|
54 |
+
|
55 |
+
checkpoint_path: /mnt/DataSSD/AI/SoteDiffusion/StableCascade/
|
56 |
+
output_path: /mnt/DataSSD/AI/SoteDiffusion/StableCascade/
|
57 |
+
webdataset_path: file:/mnt/DataSSD/AI/anime_image_dataset/best/newest_best.tar
|
58 |
+
|
59 |
+
effnet_checkpoint_path: /mnt/DataSSD/AI/models/sd-cascade/effnet_encoder.safetensors
|
60 |
+
stage_a_checkpoint_path: /mnt/DataSSD/AI/models/sd-cascade/stage_a.safetensors
|
61 |
+
generator_checkpoint_path: /mnt/DataSSD/AI/SoteDiffusion/StableCascade/sotediffusion-sc_3b-stage_b-alpha0.safetensors
|
62 |
+
```
|
63 |
+
|
64 |
+
|
65 |
+
## Limitations and Bias
|
66 |
+
|
67 |
+
### Bias
|
68 |
+
|
69 |
+
- This model is intended for anime illustrations.
|
70 |
+
Realistic capabilites are not tested at all.
|
71 |
+
- Still underbaked.
|
72 |
+
|
73 |
+
### Limitations
|
74 |
+
- Can fall back to realistic.
|
75 |
+
Add "realistic" tag to the negatives when this happens.
|
76 |
+
- Far shot eyes are can bad.
|
77 |
+
- Anatomy and hands can bad.
|
78 |
+
|
79 |
+
|
80 |
+
## License
|
81 |
+
(This part is copied directly from Animagine V3.1 and modified.)
|
82 |
+
|
83 |
+
SoteDiffusion models falls under [Fair AI Public License 1.0-SD](https://freedevproject.org/faipl-1.0-sd/) license, which is compatible with Stable Diffusion models’ license. Key points:
|
84 |
+
|
85 |
+
1. **Modification Sharing:** If you modify SoteDiffusion models, you must share both your changes and the original license.
|
86 |
+
2. **Source Code Accessibility:** If your modified version is network-accessible, provide a way (like a download link) for others to get the source code. This applies to derived models too.
|
87 |
+
3. **Distribution Terms:** Any distribution must be under this license or another with similar rules.
|
88 |
+
4. **Compliance:** Non-compliance must be fixed within 30 days to avoid license termination, emphasizing transparency and adherence to open-source values.
|
89 |
+
|
90 |
+
**Notes**: Anything not covered by Fair AI license is inherited from Stability AI Non-Commercial license which is named as LICENSE_INHERIT. Meaning, still no commercial use of any kind.
|