I made a couple more models just for fun. I can’t vouch for the quality, since I didn’t do any tests. Link to the original model and the script with which I created these models:

Himitsui/KuroMitsu-11B: https://huggingface.co/Himitsui/KuroMitsu-11B
FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script

Downloads last month: 7

GGUF

Model size

10.7B params

Architecture

llama

4-bit

5-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.