mradermacher commited on
Commit
91b42a3
·
verified ·
1 Parent(s): 7c9c303

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -4,7 +4,9 @@ language:
4
  - en
5
  library_name: transformers
6
  license: apache-2.0
7
- no_imatrix: "[ 1/ 995] blk.0.ffn_up.4.weight - [ 4096, 14336, 1, 1], type = f16, converting to iq3_xxs .. Oops: found point 1016 not on grid: 8 127 0 0"
 
 
8
  quantized_by: mradermacher
9
  tags:
10
  - moe
@@ -28,6 +30,7 @@ more details, including on how to concatenate multi-part files.
28
 
29
  | Link | Type | Size/GB | Notes |
30
  |:-----|:-----|--------:|:------|
 
31
  | [GGUF](https://huggingface.co/mradermacher/Chupacabra-8x7B-MoE-i1-GGUF/resolve/main/Chupacabra-8x7B-MoE.i1-Q2_K.gguf) | i1-Q2_K | 17.6 | IQ3_XXS probably better |
32
  | [GGUF](https://huggingface.co/mradermacher/Chupacabra-8x7B-MoE-i1-GGUF/resolve/main/Chupacabra-8x7B-MoE.i1-Q3_K_S.gguf) | i1-Q3_K_S | 20.7 | IQ3_XS probably better |
33
  | [GGUF](https://huggingface.co/mradermacher/Chupacabra-8x7B-MoE-i1-GGUF/resolve/main/Chupacabra-8x7B-MoE.i1-Q3_K_M.gguf) | i1-Q3_K_M | 22.8 | IQ3_S probably better |
 
4
  - en
5
  library_name: transformers
6
  license: apache-2.0
7
+ no_imatrix: '[ 1/ 995] blk.0.ffn_up.4.weight - [ 4096, 14336, 1, 1],
8
+ type = f16, converting to iq3_xxs .. Oops: found point 1016 not on grid: 8 127
9
+ 0 0'
10
  quantized_by: mradermacher
11
  tags:
12
  - moe
 
30
 
31
  | Link | Type | Size/GB | Notes |
32
  |:-----|:-----|--------:|:------|
33
+ | [GGUF](https://huggingface.co/mradermacher/Chupacabra-8x7B-MoE-i1-GGUF/resolve/main/Chupacabra-8x7B-MoE.i1-IQ2_M.gguf) | i1-IQ2_M | 15.4 | |
34
  | [GGUF](https://huggingface.co/mradermacher/Chupacabra-8x7B-MoE-i1-GGUF/resolve/main/Chupacabra-8x7B-MoE.i1-Q2_K.gguf) | i1-Q2_K | 17.6 | IQ3_XXS probably better |
35
  | [GGUF](https://huggingface.co/mradermacher/Chupacabra-8x7B-MoE-i1-GGUF/resolve/main/Chupacabra-8x7B-MoE.i1-Q3_K_S.gguf) | i1-Q3_K_S | 20.7 | IQ3_XS probably better |
36
  | [GGUF](https://huggingface.co/mradermacher/Chupacabra-8x7B-MoE-i1-GGUF/resolve/main/Chupacabra-8x7B-MoE.i1-Q3_K_M.gguf) | i1-Q3_K_M | 22.8 | IQ3_S probably better |