Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

10,669

Full-text search

Active filters: gguf-my-repo

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 17, 2024 • 13 • 2

hoorang/llama-3-Korean-Bllossom-8B-Q8_0-GGUF

Updated Jul 25, 2024 • 16 • 1

ooff123/lawyer-llama-13b-v2-Q4_K_M-GGUF

Updated Jul 26, 2024 • 212 • 3

iG8R/t5_translate_en_ru_zh_large_1024_v2-Q8_0-GGUF

Translation • Updated Jul 26, 2024 • 151 • 5

ooff123/DISC-LawLLM-Q4_K_M-GGUF

Updated Jul 27, 2024 • 6 • 2

ooff123/lawyer-llama-13b-v2-Q4_K_S-GGUF

Updated Jul 28, 2024 • 3 • 1

PabloSuaLap/llama-3.1-8b-instruct-reglamentacion-V1-Q4_K_M-GGUF

Text Generation • Updated Jul 30, 2024 • 1 • 1

kpranav22/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 1, 2024 • 47 • 1

cyanic-selkie/flan-t5-small-Q4_K_M-GGUF

Text2Text Generation • Updated Aug 5, 2024 • 23 • 1

networkjohnny0/DeepSeek-Coder-V2-Lite-Base-Q4_K_M-GGUF

Updated Aug 11, 2024 • 4 • 1

ysn-rfd/gpt2-Q8_0-GGUF

Updated Oct 25, 2024 • 36 • 1

neifuisan/Gemma2-9b-Neuro-sama-Q4_K_M-GGUF

Text Generation • Updated Aug 12, 2024 • 1.49k • 1

wsxiaoys/jina-embeddings-v2-base-code-Q8_0-GGUF

Feature Extraction • Updated Aug 11, 2024 • 48 • 2

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 2, 2024 • 388 • 9

hellork/calme-2.1-qwen2-7b-Q4_K_M-GGUF

Text Generation • Updated Sep 17, 2024 • 1

RealTruth/secgpt-Q8_0-GGUF

Text Generation • Updated Aug 16, 2024 • 23 • 1

urkz/sarashina2-13b-Q4_K_M-GGUF

Updated Aug 22, 2024 • 7 • 1

SteelTalon/nephra_v1.0-Q4_K_M-GGUF

Updated Aug 23, 2024 • 15 • 1

KeyurRamoliya/multilingual-e5-large-instruct-GGUF

Updated Aug 23, 2024 • 41 • 1

Triangle104/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Aug 24, 2024 • 84 • 1

jinao/secgpt-Q4_K_M-GGUF

Text Generation • Updated Aug 28, 2024 • 60 • 1

Ffftdtd5dtft/gemma-2-27b-Q2_K-GGUF

Text Generation • Updated Aug 29, 2024 • 205 • 1

Triangle104/MN-12B-Starcannon-v3-Q4_K_M-GGUF

Updated Nov 19, 2024 • 2 • 1

Triangle104/MN-12B-Starcannon-v3-Q5_K_M-GGUF

Updated Nov 19, 2024 • 1

ywms666/gpt-neox-20b-fiction-novel-generation-Q4_K_M-GGUF

Text Generation • Updated Aug 30, 2024 • 74 • 1

Triangle104/phi3.5-gutenberg-4B-Q4_K_M-GGUF

Updated Oct 27, 2024 • 12 • 1

erikbeltran/ruby-autotab-v5-Q4_K_M-GGUF

Updated Sep 2, 2024 • 4 • 1

onix331/L3-8B-Stheno-v3.2-Q6_K-GGUF

Updated Sep 3, 2024 • 2 • 2

Pelegoto/Honey-Yuzu-Mod-13B-Q5_K_M-GGUF

Updated Sep 5, 2024 • 2 • 2

Triangle104/Ellaria-9B-Q4_K_M-GGUF

Updated Sep 7, 2024 • 13 • 1