Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,453

Full-text search

Active filters: llama-cpp

SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF

Updated Dec 9, 2024 • 6 • 1

aovchinnikov/T-lite-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 145 • 5

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF

Updated Dec 11, 2024 • 10 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 11, 2024 • 28 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF

Updated Dec 11, 2024 • 13 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF

Updated Dec 12, 2024 • 12 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF

Updated Dec 12, 2024 • 16 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 9 • 1

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 77 • 2

Ransss/Nemo-12b-Humanize-KTO-Experimental-Latest-Q8_0-GGUF

Updated Dec 19, 2024 • 512 • 1

ggml-org/jina-embeddings-v2-base-en-Q8_0-GGUF

Feature Extraction • Updated Dec 12, 2024 • 45 • 1

ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF

Feature Extraction • Updated Dec 12, 2024 • 25 • 1

G17c21ds/Qwen2.5-14B-Instruct-Uncensored-Q8_0-GGUF

Updated Dec 13, 2024 • 1.91k • 5

bunnycore/Llama-3.2-1B-Creative-RP-Q8_0-GGUF

Updated Dec 13, 2024 • 11 • 1

jacobcarajo/Ministral-8B-Instruct-2410-Q5_K_M-GGUF

Updated Dec 14, 2024 • 1.02k • 1

kainatq/Kpt-7b-v-0.2-Q6_K-GGUF

Updated Dec 15, 2024 • 1 • 1

kainatq/KPT-7b-v0.2_stock-Q6_K-GGUF

Updated Dec 16, 2024 • 2 • 1

kainatq/Kpt-7b_test-Q6_K-GGUF

Updated Dec 16, 2024 • 5 • 1

matrixportal/Llama-3-Instruct-8B-SimPO-v0.2-Q4_K_M-GGUF

Updated Dec 16, 2024 • 21 • 1

kainatq/KPT-7b-v0.3-Q4_K_M-GGUF

Updated Dec 16, 2024 • 6 • 1

sander3/madlad400-10b-mt-Q8_0-GGUF

Translation • Updated Dec 16, 2024 • 40 • 1

t-tech/T-pro-it-1.0-Q5_K_M-GGUF

Updated Dec 17, 2024 • 149 • 2

t-tech/T-pro-it-1.0-Q6_K-GGUF

Updated Dec 17, 2024 • 116 • 1

t-tech/T-pro-it-1.0-Q8_0-GGUF

Updated Dec 17, 2024 • 315 • 6

prithivMLmods/Llama-Chat-Summary-3.2-3B-GGUF

Text Generation • Updated Dec 17, 2024 • 402 • 8

itlwas/aya-expanse-8b-abliterated-Q4_K_M-GGUF

Updated Dec 17, 2024 • 62 • 1

itlwas/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Dec 17, 2024 • 15 • 1

IntelligentEstate/fblgit_miniclaus-qw1.5B-UNAMGS-Q8_0-GGUF

Updated Dec 18, 2024 • 1 • 2

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q4_K_S-GGUF

Updated Dec 19, 2024 • 24 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q4_K_M-GGUF

Updated Dec 19, 2024 • 20 • 1