Hugging Face's logo

ChristianAzinn
/
mixtral-8x22b-v0.1-imatrix

Text Generation
Transformers
GGUF
English
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
Model card Files Community
ChristianAzinn commited on
Commit
9812b1e
·
verified ·
1 Parent(s): de4da01

Upload 6 files

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. mixtral-8x22b-v0.1-imatrix.q5_k_s-00001-of-00006.gguf +3 -0
  3. mixtral-8x22b-v0.1-imatrix.q5_k_s-00002-of-00006.gguf +3 -0
  4. mixtral-8x22b-v0.1-imatrix.q5_k_s-00003-of-00006.gguf +3 -0
  5. mixtral-8x22b-v0.1-imatrix.q5_k_s-00004-of-00006.gguf +3 -0
  6. mixtral-8x22b-v0.1-imatrix.q5_k_s-00005-of-00006.gguf +3 -0
  7. mixtral-8x22b-v0.1-imatrix.q5_k_s-00006-of-00006.gguf +3 -0
.gitattributes CHANGED
@@ -60,3 +60,9 @@ mixtral-8x22b-v0.1-imatrix.q6_k-00006-of-00009.gguf filter=lfs diff=lfs merge=lf
60
  mixtral-8x22b-v0.1-imatrix.q6_k-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
61
  mixtral-8x22b-v0.1-imatrix.q6_k-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
62
  mixtral-8x22b-v0.1-imatrix.q6_k-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
60
  mixtral-8x22b-v0.1-imatrix.q6_k-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
61
  mixtral-8x22b-v0.1-imatrix.q6_k-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
62
  mixtral-8x22b-v0.1-imatrix.q6_k-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
63
+ mixtral-8x22b-v0.1-imatrix.q5_k_s-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
64
+ mixtral-8x22b-v0.1-imatrix.q5_k_s-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
65
+ mixtral-8x22b-v0.1-imatrix.q5_k_s-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
66
+ mixtral-8x22b-v0.1-imatrix.q5_k_s-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
67
+ mixtral-8x22b-v0.1-imatrix.q5_k_s-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
68
+ mixtral-8x22b-v0.1-imatrix.q5_k_s-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
mixtral-8x22b-v0.1-imatrix.q5_k_s-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61bbe10dd1f4516dc252a5c8b621fd57176423cc289e555a0cab22a3b0c7f458
3
+ size 1045056064
mixtral-8x22b-v0.1-imatrix.q5_k_s-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1411240d2e93b26e8f018672b3c45f83d4e13a135414743047821815a2dd57b2
3
+ size 863999744
mixtral-8x22b-v0.1-imatrix.q5_k_s-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:254cb3ec3ac95d5124672fd24beae3fec1cd5fc2d0942ef03ddcdb6547d1e19e
3
+ size 909121280
mixtral-8x22b-v0.1-imatrix.q5_k_s-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e1daa9cb3b9eac7deceb9cf8076fbaeff752ce8c17c9a19a514e2448043ddf6
3
+ size 915855104
mixtral-8x22b-v0.1-imatrix.q5_k_s-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a4319766d1a31ebe9d4d47e6cb03e35127030a6ea0f4839aedf12c7c1724a33
3
+ size 47286872960
mixtral-8x22b-v0.1-imatrix.q5_k_s-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83e52f12d08c090ee87ba0f0bc8f6b7780ba8fa9a45405dadbf12ad3a1815c83
3
+ size 45952800928