|
--- |
|
base_model: nsfwthrowitaway69/Venus-120b-v1.0 |
|
inference: false |
|
language: |
|
- en |
|
license: llama2 |
|
model_creator: nsfwthrowitaway69 |
|
model_name: Venus 120B |
|
model_type: llama |
|
pipeline_tag: conversational |
|
quantized_by: 3-3 |
|
tags: |
|
- not-for-all-audiences |
|
--- |
|
|
|
# Venus 120B v1.0 - GGUF |
|
- Model creator: [nsfwthrowitaway69](https://huggingface.co/nsfwthrowitaway69) |
|
- Original model: [Venus 120B v1.0](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.0) |
|
|
|
## Description |
|
|
|
GGUF quants for [nsfwthrowitaway69's Venus 120B v1.0](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.0). |
|
|
|
## Provided quants |
|
|
|
| Name | Quant method | Size | |
|
| ---- | ---- | ---- | |
|
| Venus-120b-v1.0.Q2_K.gguf | Q2_K | 50.71 GB| |
|
| Venus-120b-v1.0.Q3_K_S.gguf | Q3_K_S | 51.81 GB| |
|
| Venus-120b-v1.0.Q3_K_M.gguf | Q3_K_M | 57.64 GB| |
|
| Venus-120b-v1.0.Q3_K_L.gguf | Q3_K_L | 63.01 GB| |
|
| Venus-120b-v1.0.Q4_K_S.gguf | Q4_K_S | 67.88 GB| |
|
| Venus-120b-v1.0.Q4_K_M.gguf | Q4_K_M | 72.14 GB| |
|
| Venus-120b-v1.0.Q5_K_S.gguf | Q5_K_S | 82.76 GB| |
|
| Venus-120b-v1.0.Q5_K_M.gguf | Q5_K_M | 85.02 GB| |
|
| Venus-120b-v1.0.Q6_K.gguf | Q6_K | 98.70 GB| |
|
| Venus-120b-v1.0.Q8_0.gguf | Q8_0 | 127.84 GB| |
|
|
|
## All of the files are split and require joining |
|
|
|
**Note:** HF does not support uploading files larger than 50GB. Therefore the quants have been uploaded as split files. |
|
|
|
## Q2_K - Q6_K |
|
Download the two parts of your preferred quant. For `Q6_K` that would be: |
|
* `Venus-120b-v1.0.Q6_K.gguf-split-a` |
|
* `Venus-120b-v1.0.Q6_K.gguf-split-b` |
|
|
|
## Q8_0 |
|
Download the three parts of the `Q8_0` quant: |
|
* `Venus-120b-v1.0.Q8_0.gguf-split-a` |
|
* `Venus-120b-v1.0.Q8_0.gguf-split-b` |
|
* `Venus-120b-v1.0.Q8_0.gguf-split-c` |
|
|
|
## To join the files, do the following: |
|
|
|
### Linux and macOS: |
|
```bash |
|
cat Venus-120b-v1.0.Q6_K.gguf-split-* > Venus-120b-v1.0.Q6_K.gguf && rm Venus-120b-v1.0.Q6_K.gguf-split-* |
|
``` |
|
|
|
**Note:** Replace `Q6_K` with the quant you downloaded |
|
|
|
### Windows command line: |
|
|
|
#### Q2_K - Q6_K |
|
|
|
``` |
|
COPY /B Venus-120b-v1.0.Q6_K.gguf-split-a + Venus-120b-v1.0.Q6_K.gguf-split-b Venus-120b-v1.0.Q6_K.gguf |
|
del Venus-120b-v1.0.Q6_K.gguf-split-a Venus-120b-v1.0.Q6_K.gguf-split-b |
|
``` |
|
|
|
**Note:** Replace `Q6_K` with the quant you downloaded |
|
|
|
#### Q8_K |
|
|
|
``` |
|
COPY /B Venus-120b-v1.0.Q8_0.gguf-split-a + Venus-120b-v1.0.Q8_0.gguf-split-b + Venus-120b-v1.0.Q8_0.gguf-split-c Venus-120b-v1.0.Q8_0.gguf |
|
del Venus-120b-v1.0.Q8_0.gguf-split-a Venus-120b-v1.0.Q8_0.gguf-split-b Venus-120b-v1.0.Q8_0.gguf-split-c |
|
``` |
|
|
