Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,453

Full-text search

Active filters: llama-cpp

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q5_K_S-GGUF

Updated Dec 19, 2024 • 9 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q5_K_M-GGUF

Updated Dec 19, 2024 • 7 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q6_K-GGUF

Updated Dec 19, 2024 • 15 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q8_0-GGUF

Updated Dec 19, 2024 • 12 • 1

itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 19, 2024 • 26 • 1

itlwas/Nous-Hermes-Llama2-13b-Q4_K_M-GGUF

Updated Dec 20, 2024 • 90 • 1

redhat6/Ministral-8B-Instruct-2410-Q8_0-GGUF

Updated Dec 23, 2024 • 19 • 1

matrixportal/wiroai-turkish-llm-8b-Q4_K_M-GGUF

Updated Dec 23, 2024 • 2 • 1

matrixportal/Turkish-Llama-8b-DPO-v0.1-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 22 • 1

Trappu/Magnum-Picaro-0.7-V3-12b-Q5_K_M-GGUF

Updated Dec 25, 2024 • 28 • 2

fuzzy-mittenz/Hammer2.1-3b-Q5_K_S-GGUF

Updated Dec 26, 2024 • 6 • 1

fuzzy-mittenz/Thoth-Llama3.2-3B-IQ4_NL-GGUF

Updated Dec 28, 2024 • 268 • 1

IntelligentEstate/Thoth_Warding-Llama-3B-IQ5_K_S-GGUF

Updated 27 days ago • 14 • 4

Ransss/Nemo-12b-Humanize-KTO-Experimental-Latest-B-Q8_0-GGUF

Updated 27 days ago • 537 • 1

prithivMLmods/Deepthink-Reasoning-7B-GGUF

Text Generation • Updated Dec 29, 2024 • 1.51k • 11

gghfez/32B-Qwen2.5-Kunou-v1-Q4_K_M-GGUF

Updated Dec 30, 2024 • 406 • 3

jimmylam6666/Mistral-Nemo-BD-RP-Q8_0-GGUF

Question Answering • Updated Dec 30, 2024 • 38 • 1

newsletter/deepseek-moe-16b-chat-Q8_0-GGUF

Updated Dec 30, 2024 • 842 • 1

matrixportal/Ellaria-9B-Q4_0-GGUF

Updated Dec 31, 2024 • 10 • 1

matrixportal/Ellaria-9B-Q3_K_S-GGUF

Updated Dec 31, 2024 • 16 • 1

matrixportal/L3-Umbral-Mind-RP-v3.0-8B-Q4_K_M-GGUF

Updated Dec 31, 2024 • 26 • 1

Triangle104/HuatuoGPT-o1-7B-Q4_K_M-GGUF

Text Generation • Updated Jan 6 • 57 • 1

matrixportal/ThinkerLlama-3B-Q4_K_M-GGUF

Updated Jan 1 • 4 • 1

matrixportal/Ministral-3b-instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 2 • 33 • 1

matrixportal/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

Updated Jan 2 • 27 • 1

matrixportal/Llama-Spark-Q4_0-GGUF

Updated Jan 2 • 12 • 1

matrixportal/Llama-Spark-Q4_K_M-GGUF

Updated Jan 2 • 3 • 1

matrixportal/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 2 • 51 • 1

UKPMAN0/WizardLM-7B-Uncensored-Q4_K_M-GGUF

Updated Jan 3 • 62 • 1

matrixportal/wiroai-turkish-llm-9b-Q4_K_M-GGUF

Text Generation • Updated Jan 3 • 38 • 1