File size: 528 Bytes
406b9a4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
tags:
- merge
- gguf
- not-for-all-audiences
- storywriting
- text adventure
---
# maid-yuzu-v8-alter-iMat-GGUF
Quantized from fp16 with love. iMatrix file calculated from Q8 quant using an input file from [this discussion](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)
For a brief rundown of iMatrix quant performance please see this [PR](https://github.com/ggerganov/llama.cpp/pull/5747)
Original model card can be found [here](https://huggingface.co/rhplus0831/maid-yuzu-v8-alter) |