v000000
/

L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX

Inference Endpoints

Model card Files Files and versions Community

L3.1-Niitorm-8B-LATCOSx2-Version-GGUFs-IMATRIX

1 contributor

History: 25 commits

v000000's picture

Upload l3.1-niitorm-8b-latcosx2.imat-q6_k.gguf with huggingface_hub

959f61b verified 5 months ago

.gitattributes

2.28 kB

Upload l3.1-niitorm-8b-latcosx2.imat-q6_k.gguf with huggingface_hub 5 months ago
README.md

1.21 kB

Update README.md 5 months ago
imatrix.dat

4.99 MB
LFS

Upload imatrix.dat 5 months ago
l3.1-niitorm-8b-latcosx2-q8_0.gguf

8.54 GB
LFS

Upload l3.1-niitorm-8b-latcosx2-q8_0.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-iq4_xs.gguf

4.45 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-iq4_xs.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-q4_0_4_4-ARM_SOC.gguf

4.66 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-q4_0_4_4-ARM_SOC.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-q4_0_4_8-ARM_SOC.gguf

4.66 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-q4_0_4_8-ARM_SOC.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-q4_k_m.gguf

4.92 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-q4_k_m.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-q4_k_s.gguf

4.69 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-q4_k_s.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-q5_k_m.gguf

5.73 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-q5_k_m.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-q5_k_s.gguf

5.6 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-q5_k_s.gguf with huggingface_hub 5 months ago
l3.1-niitorm-8b-latcosx2.imat-q6_k.gguf

6.6 GB
LFS

Upload l3.1-niitorm-8b-latcosx2.imat-q6_k.gguf with huggingface_hub 5 months ago