flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_8.gguf
Updated
•
8
Q4_0_4_8-GGUF
GGUF dedicated for ARM i8mm devices / Snapdragon X Elite / Snapdragon 8 Gen 1,2,3
-
-
flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_8.gguf
Updated • 62 • 1 -
flyfishstudio/llama-2-7b-chat-Q4_0_4_8.gguf
Updated • 8 -
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.gguf
Updated • 67 -
flyfishstudio/meta-llama-3.1-8b-instruct-Q4_0_4_8.gguf
Updated • 25 -
flyfishstudio/openhermes-2.5-mistral-7b-Q4_0_4_8.gguf
Updated • 27 -
flyfishstudio/orca_mini_v3_7b-Q4_0_4_8.gguf
Updated • 39 -
flyfishstudio/Phi-3.1-mini-4k-instruct-Q4_0_4_8.gguf
Updated • 142 -
flyfishstudio/Phi-3.5-mini-instruct_Uncensored-Q4_0_4_8.gguf
Updated • 272 -
flyfishstudio/Phi-3.5-mini-instruct-Q4_0_4_8.gguf
Updated • 148 -
flyfishstudio/Qwen1.5-1.8B-layla-v4-Q4_0_4_8.gguf
Updated • 12 -
flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_8.gguf
Updated • 27 -
flyfishstudio/qwen2-0_5b-instruct-Q4_0_4_8.gguf
Updated • 26 -
flyfishstudio/rocket-3b-Q4_0_4_8.gguf
Updated • 11 -
flyfishstudio/SmolLM-1.7B-Instruct-v0.2-Q4_0_4_8.gguf
Updated • 2 -
flyfishstudio/tinyllama-1.1b-chat-v1.0-Q4_0_4_8.gguf
Updated • 5 -
flyfishstudio/Mistral-7B-Instruct-v0.3-Q4_0_4_8.gguf
Updated • 18 -
flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_8.gguf
Updated • 5 -
dabr1/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-Q4_0_4_8.gguf
Updated • 254 • 3 -
dabr1/Llama-3.1-8B-Lexi-Uncensored_V2-Q4_0_4_8.gguf
Updated • 471 • 3 -
flyfishstudio/gemma_2_2b_it_v2-Q4_0_4_8.gguf
Updated • 44 -
flyfishstudio/gemma-2-9b-it-abliterated-Q4_0_4_8.gguf
Updated • 87 -
TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
Updated • 8.63k • 40 -
adamo1139/magnum-v2-4b-gguf-lowctx
Updated • 60 -
ThomasBaruzier/Llama-3.1-Minitron-4B-Width-Base-GGUF
Updated • 267 • 3 -
flyfishstudio/gemma-2-2b-it-abliterated-Q4_0_4_8.gguf
Updated • 24