xriminact
/

gemma-2-2b-it-gguf

Inference Endpoints

Model card Files Files and versions Community

gemma-2-2b-it-gguf

1 contributor

History: 11 commits

xriminact's picture

Upload gemma-2-2b-it-q3_k_m.gguf with huggingface_hub

0c3acba verified 6 months ago

.gitattributes

2 kB

Upload gemma-2-2b-it-q3_k_m.gguf with huggingface_hub 6 months ago
README.md

114 Bytes

Update README.md 6 months ago
gemma-2-2b-it-f16.gguf

5.24 GB
LFS

Upload gemma-2-2b-it-f16.gguf with huggingface_hub 6 months ago
gemma-2-2b-it-f32.gguf

10.5 GB
LFS

Upload gemma-2-2b-it-f32.gguf with huggingface_hub 6 months ago
gemma-2-2b-it-q3_k_m.gguf

1.46 GB
LFS

Upload gemma-2-2b-it-q3_k_m.gguf with huggingface_hub 6 months ago
gemma-2-2b-it-q4_0.gguf

1.63 GB
LFS

Upload gemma-2-2b-it-q4_0.gguf with huggingface_hub 6 months ago
gemma-2-2b-it-q4_k_m.gguf

1.71 GB
LFS

Upload gemma-2-2b-it-q4_k_m.gguf with huggingface_hub 6 months ago
gemma-2-2b-it-q5_0.gguf

1.88 GB
LFS

Upload gemma-2-2b-it-q5_0.gguf with huggingface_hub 6 months ago
gemma-2-2b-it-q5_k_m.gguf

1.92 GB
LFS

Upload gemma-2-2b-it-q5_k_m.gguf with huggingface_hub 6 months ago
gemma-2-2b-it-q8_0.gguf

2.78 GB
LFS

Upload gemma-2-2b-it-q8_0.gguf with huggingface_hub 6 months ago