|
--- |
|
license: apache-2.0 |
|
base_model: Felladrin/TinyMistral-248M-Chat-v2 |
|
--- |
|
|
|
GGUF version of [Felladrin/TinyMistral-248M-Chat-v2](https://huggingface.co/Felladrin/TinyMistral-248M-Chat-v2). |
|
|
|
## Try it with [llama.cpp](https://github.com/ggerganov/llama.cpp) |
|
|
|
```bash |
|
brew install ggerganov/ggerganov/llama.cpp |
|
``` |
|
```bash |
|
llama-cli \ |
|
--hf-repo Felladrin/gguf-TinyMistral-248M-Chat-v2 \ |
|
--model TinyMistral-248M-Chat-v2.Q8_0.gguf \ |
|
--random-prompt \ |
|
--temp 1.3 \ |
|
--dynatemp-range 1.2 \ |
|
--top-k 0 \ |
|
--top-p 1 \ |
|
--min-p 0.1 \ |
|
--typical 0.85 \ |
|
--mirostat 2 \ |
|
--mirostat-ent 3.5 \ |
|
--repeat-penalty 1.1 \ |
|
--repeat-last-n -1 \ |
|
-n 256 |
|
``` |
|
|
