hitachinsk
commited on
Commit
·
c12cdf7
1
Parent(s):
7756cce
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,38 @@
|
|
1 |
---
|
2 |
license: mit
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
---
|
4 |
+
# [ECCV 2022] Flow-Guided Transformer for Video Inpainting
|
5 |
+
[![LICENSE](https://img.shields.io/github/license/hitachinsk/FGT)](https://github.com/hitachinsk/FGT/blob/main/LICENSE)
|
6 |
+
|
7 |
+
### [[Paper](https://arxiv.org/abs/2208.06768)] / [[Codes](https://github.com/hitachinsk/FGT)] / [[Demo](https://youtu.be/BC32n-NncPs)] / [[Project page](https://hitachinsk.github.io/publication/2022-10-01-Flow-Guided-Transformer-for-Video-Inpainting)]
|
8 |
+
|
9 |
+
This repository hosts the pretrained models of the following paper:
|
10 |
+
> **Flow-Guided Transformer for Video Inpainting**<br>
|
11 |
+
> [Kaidong Zhang](https://hitachinsk.github.io/), [Jingjing Fu](https://www.microsoft.com/en-us/research/people/jifu/) and [Dong Liu](http://staff.ustc.edu.cn/~dongeliu/)<br>
|
12 |
+
> European Conference on Computer Vision (**ECCV**), 2022<br>
|
13 |
+
|
14 |
+
|
15 |
+
## Details
|
16 |
+
There are three models in this repository, here are the details.
|
17 |
+
|
18 |
+
- `lafc.pth.tar`: The pretrained model of "Local Aggregation Flow Completion Network", which accepts a sequence of corrupted optical flows, and outputs the completed flows.
|
19 |
+
- `lafc_single.pth.tar`: The pretrained model of the single flow completion version of "Local Aggregation Flow Completion Network", it accepts **one** corrupted flow, and outputs **one** completed flow.
|
20 |
+
- `fgt.pth.tar`: The pretrained model of "Flow Guided Transformer", which receives a sequence of corrupted frames and completed optical flows, and outputs the completed frames.
|
21 |
+
|
22 |
+
Besides the pretrained weights, we also provide the configuration files of these pretrained models.
|
23 |
+
|
24 |
+
- `LAFC_config.yaml`: The configuration file of `lafc.pth.tar`
|
25 |
+
- `LAFC_single_config.yaml`: The configuration file of `lafc_single.pth.tar`
|
26 |
+
- `FGT_config.yaml`: The configuration file of `fgt.pth.tar`
|
27 |
+
|
28 |
+
## Deployment
|
29 |
+
Download this repository to the base directory of the codes (please download that at the github page), and run "bash deploy.sh" to form the models and the cofiguration files.
|
30 |
+
|
31 |
+
After the step above, you can skip the step 1~3 in the `quick start` section in the github page and run the object removal demo directly.
|
32 |
+
|
33 |
+
|
34 |
+
|
35 |
+
|
36 |
+
|
37 |
+
|
38 |
+
|