File size: 756 Bytes
650d328 c98195f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 |
---
license: apache-2.0
base_model: Felladrin/TinyMistral-248M-Chat-v2
---
GGUF version of [Felladrin/TinyMistral-248M-Chat-v2](https://huggingface.co/Felladrin/TinyMistral-248M-Chat-v2).
## Usage with llama.cpp
```bash
brew install ggerganov/ggerganov/llama.cpp
```
```bash
llama-cli \
--hf-repo Felladrin/gguf-TinyMistral-248M-Chat-v2 \
--model TinyMistral-248M-Chat-v2.Q8_0.gguf \
-p "<|im_start|>system\nYou are a helpful assistant who answers user's questions with details and curiosity.<|im_end|>\n<|im_start|>user\nWhat are some potential applications for quantum computing?<|im_end|>\n<|im_start|>assistant\n" \
-e \
--dynatemp-range "0.1-0.35" \
--min-p 0.05 \
--repeat-penalty 1.1 \
-c 2048 \
-n 250 \
-r "<|im_end|>"
```
|