Update README.md
Browse files
README.md
CHANGED
|
@@ -6,32 +6,46 @@ tags:
|
|
| 6 |
- hunyuan
|
| 7 |
---
|
| 8 |
|
|
|
|
|
|
|
|
|
|
| 9 |
Our training dataset consists solely of Wukong videos and can be accessed [here](https://huggingface.co/datasets/FastVideo/Black-Myth-Wukong)
|
| 10 |
# Black-Myth-Wukong
|
| 11 |
|
| 12 |
<div style="display: flex; flex-direction: column; gap: 16px;">
|
| 13 |
-
|
| 14 |
-
<
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
<
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 35 |
</div>
|
| 36 |
<b>Prompt:</b> "Against a backdrop of ancient trees shrouded in mist, Wukong stands prominently, his sophisticated black sunglasses adding a modern edge to his mythical appearance. His face, a striking blend of human and simian traits, is characterized by intense eyes behind the dark lenses and dense fur that frames his strong features. The ornate golden armor with swirling patterns shimmers as he crosses his arms across his chest, his posture exuding authority. He nods his head rhythmically, a subtle smile playing on his lips as the sunglasses reflect the diffused light."
|
| 37 |
|
|
@@ -45,17 +59,15 @@ Our training dataset consists solely of Wukong videos and can be accessed [here]
|
|
| 45 |
|
| 46 |
<b>Prompt:</b> "Against a peaceful backdrop decorated with paper-cut designs, Wukong stands with a tray of mandarin oranges, his stylish sunglasses harmonizing with his fur-covered face showing gracious hospitality. His elaborate golden armor adorned with swirling patterns catches the gentle light as he offers the lucky fruit, his strong simian features radiating traditional courtesy."
|
| 47 |
|
| 48 |
-
**Detailed finetuning instructions are available in our GitHub repository.**
|
| 49 |
|
| 50 |
-
You can easily perform inference using the LoRA weights in our [FastVideo](https://github.com/hao-ai-lab/FastVideo) repository, supporting both single and multi-GPU configurations.
|
| 51 |
## Trainig details:
|
| 52 |
- LR: 1e-4
|
| 53 |
- Optimizer: adamw
|
| 54 |
- steps: 6000
|
| 55 |
-
- dataset: 22 (180*
|
| 56 |
- rank: 32
|
| 57 |
- alpha: 32
|
| 58 |
-
- batch size:
|
| 59 |
- gradient accumulation steps: 1
|
| 60 |
|
| 61 |
## Acknowledgment:
|
|
|
|
| 6 |
- hunyuan
|
| 7 |
---
|
| 8 |
|
| 9 |
+
**Hunyuan supports Lora fine-tuning of videos up to 720p. Detailed finetuning instructions are available in our GitHub repository.**
|
| 10 |
+
|
| 11 |
+
You can easily perform inference using the LoRA weights in our [FastVideo](https://github.com/hao-ai-lab/FastVideo) repository, supporting both single and multi-GPU configurations.
|
| 12 |
Our training dataset consists solely of Wukong videos and can be accessed [here](https://huggingface.co/datasets/FastVideo/Black-Myth-Wukong)
|
| 13 |
# Black-Myth-Wukong
|
| 14 |
|
| 15 |
<div style="display: flex; flex-direction: column; gap: 16px;">
|
| 16 |
+
<!-- Row 1 -->
|
| 17 |
+
<div style="display: flex; gap: 16px;">
|
| 18 |
+
<video width="48%" height="auto" controls>
|
| 19 |
+
<source src="https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight/resolve/main/demo_1.mp4"
|
| 20 |
+
type="video/mp4">
|
| 21 |
+
</video>
|
| 22 |
+
<video width="48%" height="auto" controls>
|
| 23 |
+
<source src="https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight/resolve/main/demo_0.mp4"
|
| 24 |
+
type="video/mp4">
|
| 25 |
+
</video>
|
| 26 |
+
</div>
|
| 27 |
+
<!-- Row 2 -->
|
| 28 |
+
<div style="display: flex; gap: 16px;">
|
| 29 |
+
<video width="48%" height="auto" controls>
|
| 30 |
+
<source src="https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight/resolve/main/demo_4.mp4"
|
| 31 |
+
type="video/mp4">
|
| 32 |
+
</video>
|
| 33 |
+
<video width="48%" height="auto" controls>
|
| 34 |
+
<source src="https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight/resolve/main/demo_5.mp4"
|
| 35 |
+
type="video/mp4">
|
| 36 |
+
</video>
|
| 37 |
+
</div>
|
| 38 |
+
<!-- Row 3 -->
|
| 39 |
+
<div style="display: flex; gap: 16px;">
|
| 40 |
+
<video width="48%" height="auto" controls>
|
| 41 |
+
<source src="https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight/resolve/main/demo_2.mp4"
|
| 42 |
+
type="video/mp4">
|
| 43 |
+
</video>
|
| 44 |
+
<video width="48%" height="auto" controls>
|
| 45 |
+
<source src="https://huggingface.co/FastVideo/Hunyuan-Black-Myth-Wukong-lora-weight/resolve/main/demo_3.mp4"
|
| 46 |
+
type="video/mp4">
|
| 47 |
+
</video>
|
| 48 |
+
</div>
|
| 49 |
</div>
|
| 50 |
<b>Prompt:</b> "Against a backdrop of ancient trees shrouded in mist, Wukong stands prominently, his sophisticated black sunglasses adding a modern edge to his mythical appearance. His face, a striking blend of human and simian traits, is characterized by intense eyes behind the dark lenses and dense fur that frames his strong features. The ornate golden armor with swirling patterns shimmers as he crosses his arms across his chest, his posture exuding authority. He nods his head rhythmically, a subtle smile playing on his lips as the sunglasses reflect the diffused light."
|
| 51 |
|
|
|
|
| 59 |
|
| 60 |
<b>Prompt:</b> "Against a peaceful backdrop decorated with paper-cut designs, Wukong stands with a tray of mandarin oranges, his stylish sunglasses harmonizing with his fur-covered face showing gracious hospitality. His elaborate golden armor adorned with swirling patterns catches the gentle light as he offers the lucky fruit, his strong simian features radiating traditional courtesy."
|
| 61 |
|
|
|
|
| 62 |
|
|
|
|
| 63 |
## Trainig details:
|
| 64 |
- LR: 1e-4
|
| 65 |
- Optimizer: adamw
|
| 66 |
- steps: 6000
|
| 67 |
+
- dataset: 22 (180*1280x720) videos
|
| 68 |
- rank: 32
|
| 69 |
- alpha: 32
|
| 70 |
+
- batch size: 1
|
| 71 |
- gradient accumulation steps: 1
|
| 72 |
|
| 73 |
## Acknowledgment:
|