Hugging Face's logo

KoboldAI
/
Mixtral-8x7B-Holodeck-v1-GGUF

Text Generation
GGUF
PyTorch
English
mixtral
fine-tuned
Mixture of Experts
Inference Endpoints
Model card Files Community
The Big Blender commited on
Commit
c27ebc8
·
1 Parent(s): 4786fe9

Initial Upload

Browse files
Files changed (15) hide show
  1. .gitattributes +1 -0
  2. Mixtral-8x7B-holodeck-v1.Q2_K.gguf +3 -0
  3. Mixtral-8x7B-holodeck-v1.Q3_K_L.gguf +3 -0
  4. Mixtral-8x7B-holodeck-v1.Q3_K_M.gguf +3 -0
  5. Mixtral-8x7B-holodeck-v1.Q3_K_S.gguf +3 -0
  6. Mixtral-8x7B-holodeck-v1.Q4_0.gguf +3 -0
  7. Mixtral-8x7B-holodeck-v1.Q4_1.gguf +3 -0
  8. Mixtral-8x7B-holodeck-v1.Q4_K_M.gguf +3 -0
  9. Mixtral-8x7B-holodeck-v1.Q4_K_S.gguf +3 -0
  10. Mixtral-8x7B-holodeck-v1.Q5_0.gguf +3 -0
  11. Mixtral-8x7B-holodeck-v1.Q5_1.gguf +3 -0
  12. Mixtral-8x7B-holodeck-v1.Q5_K_M.gguf +3 -0
  13. Mixtral-8x7B-holodeck-v1.Q5_K_S.gguf +3 -0
  14. Mixtral-8x7B-holodeck-v1.Q6_K.gguf +3 -0
  15. Mixtral-8x7B-holodeck-v1.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -1,6 +1,7 @@
1
  *.7z filter=lfs diff=lfs merge=lfs -text
2
  *.arrow filter=lfs diff=lfs merge=lfs -text
3
  *.bin filter=lfs diff=lfs merge=lfs -text
 
4
  *.bz2 filter=lfs diff=lfs merge=lfs -text
5
  *.ckpt filter=lfs diff=lfs merge=lfs -text
6
  *.ftz filter=lfs diff=lfs merge=lfs -text
 
1
  *.7z filter=lfs diff=lfs merge=lfs -text
2
  *.arrow filter=lfs diff=lfs merge=lfs -text
3
  *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.gguf filter=lfs diff=lfs merge=lfs -text
5
  *.bz2 filter=lfs diff=lfs merge=lfs -text
6
  *.ckpt filter=lfs diff=lfs merge=lfs -text
7
  *.ftz filter=lfs diff=lfs merge=lfs -text
Mixtral-8x7B-holodeck-v1.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f69e03de74431cc95712c9c70354bf15f3472560f0a8f90dc8b34f07fedd6435
3
+ size 17309173056
Mixtral-8x7B-holodeck-v1.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f2fe118c958e100085663589cca47d21d87ad699928b680420103a6b548bdd0
3
+ size 24167589184
Mixtral-8x7B-holodeck-v1.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a20bc554b4f8cdf6786f6c3c407dacbb0e95aec94689ebe7188572f8ed857f6
3
+ size 22544393536
Mixtral-8x7B-holodeck-v1.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1e51ed3c21142fa3cfb391c73f051660675165bcef397862d0ef9c5bfd9abf0
3
+ size 20430464320
Mixtral-8x7B-holodeck-v1.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e390eda65ba4df56551a66dea3b84bf1337de8a7d04742867aa19b3260070aa
3
+ size 26441532736
Mixtral-8x7B-holodeck-v1.Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:729c9d888534ee6feec5cdf6400cbb03bce5fcb72df1e8cbc79096d038616134
3
+ size 29335405888
Mixtral-8x7B-holodeck-v1.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a57778386bf8cb9967b0b333e3fb9d2fcd3008fba192de9ac87e158d2fefe8e
3
+ size 28446410048
Mixtral-8x7B-holodeck-v1.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:524006371e761cf2299df578762dd06f573d25fe7e0468c096968e2b23bf82ec
3
+ size 26743522624
Mixtral-8x7B-holodeck-v1.Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:807210ad68507a23e69aa53080dea4f50679ccbc3e41206bb0eac3f91ee9f766
3
+ size 32229279040
Mixtral-8x7B-holodeck-v1.Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c511e9a73601db81c7d4d113f2519afce609afc8cfdd5e68d23e0a8b169e4f1
3
+ size 35123152192
Mixtral-8x7B-holodeck-v1.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d46391934660da6d02b0787e810bb76a2825c9e3206eb3a1ee3c46218418e898
3
+ size 33227523392
Mixtral-8x7B-holodeck-v1.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:916ce37ff0421321b8678457ec7b696c7daa44cf19482e9d4568526a5d3a16a9
3
+ size 32229279040
Mixtral-8x7B-holodeck-v1.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcb4f2ce4a0952f911cc76a5b329025e3938ebb6ce61757d1aaaae400f95313a
3
+ size 38378759488
Mixtral-8x7B-holodeck-v1.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d29004f75541b49732ebb2904e3b95b61670f1a3ca59e4a5af224ee01c1b5cf
3
+ size 49624261952