Unnamed User
commited on
Commit
·
769e42a
1
Parent(s):
3d20c1a
updating README
Browse files
README.md
CHANGED
@@ -1,3 +1,73 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
tags:
|
4 |
+
- stable diffusion
|
5 |
+
- animatediff
|
6 |
+
- motion lora
|
7 |
+
language:
|
8 |
+
- en
|
9 |
---
|
10 |
+
- [Basic camera motion LoRAs](#basic-camera-motion-loras)
|
11 |
+
- [Model Description](#model-description)
|
12 |
+
- [File summary](#file-summary)
|
13 |
+
- [General recommendation](#general-recommendation)
|
14 |
+
- [Details and examples](#details-and-examples)
|
15 |
+
- [Walking front view](#walking-front-view)
|
16 |
+
- [Walking back view](#walking-back-view)
|
17 |
+
- [Walking right view](#walking-right-view)
|
18 |
+
- [Walking left view](#walking-left-view)
|
19 |
+
|
20 |
+
# Basic camera motion LoRAs
|
21 |
+
|
22 |
+
## Model Description
|
23 |
+
This repository contains a collection of motion LoRAs finetuned on Animatediff v2 models.
|
24 |
+
|
25 |
+
## File summary
|
26 |
+
|
27 |
+
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
|
28 |
+
| ---------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
|
29 |
+
| 1900_cseti_6931403_walking-frontview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
|
30 |
+
| 1600_cseti_1065173_walking-backview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
|
31 |
+
| 1100_cseti_6134549_walking-left-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
|
32 |
+
| 1100_cseti_8836021_walking-right-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
|
33 |
+
|
34 |
+
|
35 |
+
## General recommendation
|
36 |
+
|
37 |
+
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
|
38 |
+
- They work with SD 1.5
|
39 |
+
- Animatediff v3 adapter lora is recommended regardless they are v2 models
|
40 |
+
- If you want more motion try incrasing the scale multival (e.g. to 1.2)
|
41 |
+
- I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
|
42 |
+
- Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
|
43 |
+
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
|
44 |
+
|
45 |
+
## Details and examples
|
46 |
+
|
47 |
+
### Walking front view
|
48 |
+
- Recommended keywords: front-view, walking
|
49 |
+
- LoRA strength: 0.8-1.0
|
50 |
+
- scale multival / motion scale: 1.0-1.2
|
51 |
+
|
52 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
|
53 |
+
|
54 |
+
### Walking back view
|
55 |
+
- Recommended keywords: back-view, walking
|
56 |
+
- LoRA strength: 0.8-1.0
|
57 |
+
- scale multival / motion scale: 1.0-1.2
|
58 |
+
|
59 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
|
60 |
+
|
61 |
+
### Walking right view
|
62 |
+
- Recommended keywords: side-view, facing right, walking
|
63 |
+
- LoRA strength: 0.5-1.0
|
64 |
+
- scale multival / motion scale: 1.0-1.2
|
65 |
+
|
66 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
|
67 |
+
|
68 |
+
### Walking left view
|
69 |
+
- Recommended keywords: side-view, facing left, walking
|
70 |
+
- LoRA strength: 0.5-1.0
|
71 |
+
- scale multival / motion scale: 1.0-1.2
|
72 |
+
|
73 |
+
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
|