flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf
Updated
•
5
Q4_0_4_4-GGUF
GGUF dedicated for ARM NEON devices
-
-
flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf
Updated • 26 -
flyfishstudio/rocket-3b-Q4_0_4_4.gguf
Updated • 3 -
flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf
Updated • 4 -
flyfishstudio/openhermes-2.5-mistral-7b-Q4_0_4_4.gguf
Updated • 21 -
flyfishstudio/meta-llama-3.1-8b-instruct-Q4_0_4_4.gguf
Updated • 19 -
flyfishstudio/orca_mini_v3_7b-Q4_0_4_4.gguf
Updated • 21 -
flyfishstudio/SmolLM-1.7B-Instruct-v0.2-Q4_0_4_4.gguf
Updated • 2 -
flyfishstudio/Qwen1.5-1.8B-layla-v4-Q4_0_4_4.gguf
Updated • 2 -
flyfishstudio/Mistral-7B-Instruct-v0.3-Q4_0_4_4.gguf
Updated • 24 -
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_4.gguf
Updated • 53 -
flyfishstudio/tinyllama-1.1b-chat-v1.0-Q4_0_4_4.gguf
Updated • 9 -
flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_4.gguf
Updated • 16 -
flyfishstudio/qwen2-0_5b-instruct-Q4_0_4_4.gguf
Updated • 53 -
flyfishstudio/Phi-3.5-mini-instruct_Uncensored-Q4_0_4_4.gguf
Updated • 249 -
flyfishstudio/Phi-3.5-mini-instruct-Q4_0_4_4.gguf
Updated • 118 -
flyfishstudio/Phi-3.1-mini-4k-instruct-Q4_0_4_4.gguf
Updated • 124 -
flyfishstudio/llama-2-7b-chat-Q4_0_4_4.gguf
Updated • 4 -
flyfishstudio/gemma_2_2b_it_v2-Q4_0_4_4.gguf
Updated • 28 -
flyfishstudio/gemma-2-9b-it-abliterated-Q4_0_4_4.gguf
Updated • 29 -
TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
Updated • 10.4k • 40 -
adamo1139/magnum-v2-4b-gguf-lowctx
Updated • 71 -
ThomasBaruzier/Llama-3.1-Minitron-4B-Width-Base-GGUF
Updated • 276 • 3 -
flyfishstudio/gemma-2-2b-it-abliterated-Q4_0_4_4.gguf
Updated • 20