Update README.md
Browse files
README.md
CHANGED
@@ -23,13 +23,30 @@ widget:
|
|
23 |
pipeline_tag: zero-shot-image-classification
|
24 |
---
|
25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
![](barchart_zeroshot.png)
|
27 |
|
28 |
-
# Model card for QuiltNet-B-32
|
29 |
|
30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
|
32 |
-
A CLIP ViT-B/32 model trained with the Quilt-1M dataset (https://quilt1m.github.io/) using OpenCLIP (https://github.com/mlfoundations/open_clip).
|
33 |
|
34 |
# Uses
|
35 |
|
@@ -82,19 +99,3 @@ It is important to note that the results obtained from this function are not int
|
|
82 |
In accordance with the privacy policy of Youtube, only Video IDs data is redistributed by us.
|
83 |
It is strictly prohibited to redistribute any content apart from the Video IDs.
|
84 |
Any distribution carried out must adhere to the laws and regulations applicable in your jurisdiction, including export control laws and embargoes.'
|
85 |
-
|
86 |
-
|
87 |
-
|
88 |
-
# Citation
|
89 |
-
|
90 |
-
**BibTeX:**
|
91 |
-
|
92 |
-
Quilt-1M
|
93 |
-
```bibtex
|
94 |
-
@inproceedings{ikezogwo2023quilt,
|
95 |
-
title={Quilt-1M: One Million Image-Text Pairs for Histopathology},
|
96 |
-
author={Wisdom O. Ikezogwo, Mehmet S. Seyfioglu, Fatemeh Ghezloo, Dylan Geva , Fatwir S. Mohammed, Pavan K. Anand, Ranjay Krishna, Linda G. Shapiro.},
|
97 |
-
year={2023},
|
98 |
-
journal={arXiv***},
|
99 |
-
}
|
100 |
-
```
|
|
|
23 |
pipeline_tag: zero-shot-image-classification
|
24 |
---
|
25 |
|
26 |
+
|
27 |
+
## QuiltNet-B-32 Description
|
28 |
+
|
29 |
+
QuiltNet-B-32 is a CLIP ViT-B/32 vision-language foundation model trained on the [Quilt-1M](https://quilt1m.github.io/) dataset.
|
30 |
+
It can perform various vision-language processing (VLP) tasks such as cross-modal retrieval, image classification, and visual question answering.
|
31 |
+
QuiltNet establishes new state of the art in a wide range of standard datasets, and substantially outperforms prior VLP approaches:
|
32 |
+
|
33 |
![](barchart_zeroshot.png)
|
34 |
|
|
|
35 |
|
36 |
+
# Citation
|
37 |
+
|
38 |
+
**BibTeX:**
|
39 |
+
|
40 |
+
Quilt-1M
|
41 |
+
```bibtex
|
42 |
+
@inproceedings{ikezogwo2023quilt,
|
43 |
+
title={Quilt-1M: One Million Image-Text Pairs for Histopathology},
|
44 |
+
author={Wisdom O. Ikezogwo, Mehmet S. Seyfioglu, Fatemeh Ghezloo, Dylan Geva , Fatwir S. Mohammed, Pavan K. Anand, Ranjay Krishna, Linda G. Shapiro.},
|
45 |
+
year={2023},
|
46 |
+
journal={arXiv***},
|
47 |
+
}
|
48 |
+
```
|
49 |
|
|
|
50 |
|
51 |
# Uses
|
52 |
|
|
|
99 |
In accordance with the privacy policy of Youtube, only Video IDs data is redistributed by us.
|
100 |
It is strictly prohibited to redistribute any content apart from the Video IDs.
|
101 |
Any distribution carried out must adhere to the laws and regulations applicable in your jurisdiction, including export control laws and embargoes.'
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|