Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
7
MaziyarPanahi commited on
Commit
b3ee5f5
·
verified ·
1 Parent(s): a73b6a1

4e6bcfe7735d52f4413bcc3467309f462f76c4faec3f2dd2124d6d40ecbdf5bd

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  Meta-Llama-3.1-70B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
  Meta-Llama-3.1-70B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
  Meta-Llama-3.1-70B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
36
  Meta-Llama-3.1-70B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
  Meta-Llama-3.1-70B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
  Meta-Llama-3.1-70B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-70B-Instruct.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f953fe1cdeae9b4c6d8dd806d1c1223f2eaa5d900c23cf788d1aa0718c028ccd
3
+ size 30912051328