mradermacher
/

sonnet-llama-3.2-3b-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Oct 31, 2024

Commit

d47456c

·

verified ·

1 Parent(s): 3547d5a

uploaded from nethype/nico1

Files changed (2) hide show

.gitattributes +1 -1
sonnet-llama-3.2-3b.Q8_0.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -40,4 +40,4 @@ sonnet-llama-3.2-3b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
-sonnet-llama-3.2-3b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text

 sonnet-llama-3.2-3b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+sonnet-llama-3.2-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

sonnet-llama-3.2-3b.Q8_0.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9acdb3f764b8f1a2c241be7a6c6095ef7cf4d066fc5309b4f09e28805cc99112
+size 3421900576