Update README.md
Browse files
README.md
CHANGED
@@ -34,6 +34,22 @@ The model was trained on balanced multilingual dataset.
|
|
34 |
|
35 |
If you need English model, check [this](https://huggingface.co/unum-cloud/uform-vl-english).
|
36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
37 |
|
38 |
## Installation
|
39 |
|
|
|
34 |
|
35 |
If you need English model, check [this](https://huggingface.co/unum-cloud/uform-vl-english).
|
36 |
|
37 |
+
## Evaluation
|
38 |
+
|
39 |
+
The following metrics were obtained with multimodal re-ranking:
|
40 |
+
|
41 |
+
**Monolingual**
|
42 |
+
|
43 |
+
| Dataset | Recall@1 | Recall@5 | Recall@10 |
|
44 |
+
| :-------- | ------: | --------: | --------: |
|
45 |
+
| Zero-Shot Flickr | 0.558 | 0.813 | 0.874 |
|
46 |
+
| MS-COCO (train split was in training data) | 0.401 | 0.680 | 0.781 |
|
47 |
+
|
48 |
+
**Multilingual**
|
49 |
+
|
50 |
+
| English | German | Spanish | French | Italian | Russian | Japanese | Korean | Turkish | Chinese | Polish |
|
51 |
+
| -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------: | -------:
|
52 |
+
96.3 | 92.6 | 94.5 | 94.4 | 94.4 | 90.4 | 88.3 | 92.5 | 94.4 | 93.6 | 95.0 |
|
53 |
|
54 |
## Installation
|
55 |
|