Update README.md
Browse files
README.md
CHANGED
@@ -102,7 +102,7 @@ It is the result of quantising to 4bit using [AutoGPTQ](https://github.com/PanQi
|
|
102 |
## Repositories available
|
103 |
|
104 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/starcoderplus-GPTQ)
|
105 |
-
* [
|
106 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/bigcode/starcoderplus)
|
107 |
|
108 |
## How to easily download and use this model in text-generation-webui
|
|
|
102 |
## Repositories available
|
103 |
|
104 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/starcoderplus-GPTQ)
|
105 |
+
* [4, 5, and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/starcoderplus-GGML)
|
106 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/bigcode/starcoderplus)
|
107 |
|
108 |
## How to easily download and use this model in text-generation-webui
|