|
--- |
|
base_model: Sao10K/MN-BackyardAI-Party-12B-v1 |
|
language: |
|
- en |
|
quantized_by: Lewdiculous |
|
library_name: transformers |
|
license: cc-by-nc-4.0 |
|
tags: |
|
- mistral |
|
- arm |
|
- i8mm |
|
- mobile |
|
- roleplay |
|
--- |
|
My GGUF-IQ-Imatrix quants for [Sao10K/MN-BackyardAI-Party-12B-v1](https://huggingface.co/Sao10K/MN-BackyardAI-Party-12B-v1). |
|
|
|
"For best results, set both `<|im_end|>` and `[INST]` as stopping strings. Recommended Temperature is <1 , min_p of at least 0.1." |
|
|
|
"This does require a lot of tinkering to fit within SillyTavern / other frontends." |
|
|
|
> [!NOTE] |
|
> Prompting: |
|
> * Similar to **Mistral** for group chats (please read the original model page for information on this) |
|
> * **ChatML** for one-on-one chats |
|
|
|
 |
