Hugging Face's logo

mradermacher
/
Hercules-3-1B-GGUF

Transformers
GGUF
English
text-generation-inference
unsloth
llama
trl
Inference Endpoints
conversational
Model card Files Community
mradermacher commited on
Commit
b28e942
·
verified ·
1 Parent(s): c35a873

uploaded from kaos

Browse files
Files changed (13) hide show
  1. .gitattributes +12 -0
  2. Hercules-3-1B.IQ4_XS.gguf +3 -0
  3. Hercules-3-1B.Q2_K.gguf +3 -0
  4. Hercules-3-1B.Q3_K_L.gguf +3 -0
  5. Hercules-3-1B.Q3_K_M.gguf +3 -0
  6. Hercules-3-1B.Q3_K_S.gguf +3 -0
  7. Hercules-3-1B.Q4_K_M.gguf +3 -0
  8. Hercules-3-1B.Q4_K_S.gguf +3 -0
  9. Hercules-3-1B.Q5_K_M.gguf +3 -0
  10. Hercules-3-1B.Q5_K_S.gguf +3 -0
  11. Hercules-3-1B.Q6_K.gguf +3 -0
  12. Hercules-3-1B.Q8_0.gguf +3 -0
  13. Hercules-3-1B.f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Hercules-3-1B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Hercules-3-1B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Hercules-3-1B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Hercules-3-1B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Hercules-3-1B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Hercules-3-1B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Hercules-3-1B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Hercules-3-1B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Hercules-3-1B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Hercules-3-1B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Hercules-3-1B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Hercules-3-1B.f16.gguf filter=lfs diff=lfs merge=lfs -text
Hercules-3-1B.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ca49c497b8be158907e6cc73e3cf79c8dc96dffe3316940c62ab92982126d8e
3
+ size 974715200
Hercules-3-1B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8612fe33ab164a7a6e701694a816e7b3f4e137c7e3042e920934586248217dbb
3
+ size 727087424
Hercules-3-1B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c18de83dc38a96b003095fdf7866c379799f9aaa37d2bd80102d98b12e4d005
3
+ size 934246720
Hercules-3-1B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e798b75fcca9b14c1c63f9c459a4066063157b7187764f688c28b37a2f4db8fd
3
+ size 884963648
Hercules-3-1B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6733ebe22d774eb06684ac36d4d7232aea6472d87b7e4229de0aec9a8e99a3bc
3
+ size 827193664
Hercules-3-1B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbc7edd81b268db94c5230b57b452a21220a0d042cd614ff6592ac78b556a0cb
3
+ size 1057044800
Hercules-3-1B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:756f00b8ddd507cde11b3fee4f9858958bae15f12d2d72e8db6abef997336f16
3
+ size 1018493248
Hercules-3-1B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f9f46278eeef2dc3d815011ec451953e1c10023083ca7c277122bc5341c72c0
3
+ size 1210923328
Hercules-3-1B.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d87a735a828e70f3e890010a4fe8e4fe2872264dbcbb5395aa4f78b69db48ab
3
+ size 1188362560
Hercules-3-1B.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad7f4cc5153a7022a30185fda269bb70e756d239b7d4cfe2e12212acb35c2034
3
+ size 1374419264
Hercules-3-1B.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28ab61cdc1076b0c561d13f31b57505cfcc75cc1601a2083ea32938c8dc51fcf
3
+ size 1778710848
Hercules-3-1B.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:718d39320f9d8134b8668dcc831e19ec0d6602aac54f15e9a84b184e2de6894b
3
+ size 3343710528