Unnamed User commited on
Commit
769e42a
·
1 Parent(s): 3d20c1a

updating README

Browse files
Files changed (1) hide show
  1. README.md +70 -0
README.md CHANGED
@@ -1,3 +1,73 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ tags:
4
+ - stable diffusion
5
+ - animatediff
6
+ - motion lora
7
+ language:
8
+ - en
9
  ---
10
+ - [Basic camera motion LoRAs](#basic-camera-motion-loras)
11
+ - [Model Description](#model-description)
12
+ - [File summary](#file-summary)
13
+ - [General recommendation](#general-recommendation)
14
+ - [Details and examples](#details-and-examples)
15
+ - [Walking front view](#walking-front-view)
16
+ - [Walking back view](#walking-back-view)
17
+ - [Walking right view](#walking-right-view)
18
+ - [Walking left view](#walking-left-view)
19
+
20
+ # Basic camera motion LoRAs
21
+
22
+ ## Model Description
23
+ This repository contains a collection of motion LoRAs finetuned on Animatediff v2 models.
24
+
25
+ ## File summary
26
+
27
+ | Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
28
+ | ---------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
29
+ | 1900_cseti_6931403_walking-frontview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
30
+ | 1600_cseti_1065173_walking-backview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
31
+ | 1100_cseti_6134549_walking-left-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
32
+ | 1100_cseti_8836021_walking-right-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
33
+
34
+
35
+ ## General recommendation
36
+
37
+ - These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
38
+ - They work with SD 1.5
39
+ - Animatediff v3 adapter lora is recommended regardless they are v2 models
40
+ - If you want more motion try incrasing the scale multival (e.g. to 1.2)
41
+ - I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
42
+ - Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
43
+ - I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
44
+
45
+ ## Details and examples
46
+
47
+ ### Walking front view
48
+ - Recommended keywords: front-view, walking
49
+ - LoRA strength: 0.8-1.0
50
+ - scale multival / motion scale: 1.0-1.2
51
+
52
+ <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
53
+
54
+ ### Walking back view
55
+ - Recommended keywords: back-view, walking
56
+ - LoRA strength: 0.8-1.0
57
+ - scale multival / motion scale: 1.0-1.2
58
+
59
+ <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
60
+
61
+ ### Walking right view
62
+ - Recommended keywords: side-view, facing right, walking
63
+ - LoRA strength: 0.5-1.0
64
+ - scale multival / motion scale: 1.0-1.2
65
+
66
+ <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
67
+
68
+ ### Walking left view
69
+ - Recommended keywords: side-view, facing left, walking
70
+ - LoRA strength: 0.5-1.0
71
+ - scale multival / motion scale: 1.0-1.2
72
+
73
+ <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>