Adding some more quantized models
Browse files- qwen-14b-chat-q3k-k-m.gguf +3 -0
- qwen-14b-chat-q4k-k-s.gguf +3 -0
- qwen-14b-chat-q5-0.gguf +3 -0
qwen-14b-chat-q3k-k-m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3630696df0fb8a2ddc9028c39ffa2c04e83ca46bafbdcc10ea28095e51938fb1
|
| 3 |
+
size 7690230528
|
qwen-14b-chat-q4k-k-s.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64b43ac71a0a77a52bf69cca12d6525277d2f5539fee85c387f0c17e1b766fcb
|
| 3 |
+
size 8551844608
|
qwen-14b-chat-q5-0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7ecc891a8eedbaf98c76d7e276406f09698c07cdc1558ede96830c1dc38c2ea1
|
| 3 |
+
size 10028083968
|