CompendiumLabs
/

bge-base-en-v1.5-gguf

Inference Endpoints

feature-extraction

Model card Files Files and versions Community

iamlemec commited on Feb 17, 2024

Commit

24914ef

·

verified ·

1 Parent(s): 2864c39

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -17,10 +17,10 @@ Quantized and unquantized embedding models in GGUF format for use with `llama.cp
 | Filename | Quantization | Size |
 |:-------- | ------------ | ---- |
-| [bge-base-en-v1.5-f32.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-f32.gguf) | F32 | 436 MB |
-| [bge-base-en-v1.5-f16.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-f16.gguf) | F16 | 219 MB |
-| [bge-base-en-v1.5-q8_0.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-q8_0.gguf) | Q8_0 | 118 MB |
-| [bge-base-en-v1.5-q4_k_m.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-q4_k_m.gguf) | Q4_K_M | 68 MB |
 </div>

 | Filename | Quantization | Size |
 |:-------- | ------------ | ---- |
+| [bge-base-en-v1.5-f32.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-f32.gguf) | F32 | 417 MB |
+| [bge-base-en-v1.5-f16.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-f16.gguf) | F16 | 209 MB |
+| [bge-base-en-v1.5-q8_0.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-q8_0.gguf) | Q8_0 | 113 MB |
+| [bge-base-en-v1.5-q4_k_m.gguf](https://huggingface.co/CompendiumLabs/bge-base-en-v1.5-gguf/blob/main/bge-base-en-v1.5-q4_k_m.gguf) | Q4_K_M | 66 MB |
 </div>