mradermacher
/

sonnet-llama-3.2-3b-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Oct 31, 2024

Commit

2c26365

·

verified ·

1 Parent(s): d47456c

uploaded from nethype/nico1

Files changed (2) hide show

.gitattributes +1 -0
sonnet-llama-3.2-3b.Q5_K_M.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -41,3 +41,4 @@ sonnet-llama-3.2-3b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

 sonnet-llama-3.2-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 sonnet-llama-3.2-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+sonnet-llama-3.2-3b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text

sonnet-llama-3.2-3b.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:464fcd069e9924872780504f13427ac3f0e93df6202831d3248b910a2d1f387c
+size 2322155296