Edit Models filters

Inference status

Misc

AutoTrain Compatible

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,657

Full-text search

Active filters: 2-bit

MaziyarPanahi/SmolLM2-360M-Instruct-GGUF

Text Generation • Updated Nov 3, 2024 • 76 • 2

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • Updated Nov 6, 2024 • 3.08k • 1

MaziyarPanahi/Mistral-Crab-DPO-GGUF

Text Generation • Updated Nov 7, 2024 • 46 • 2

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated Nov 7, 2024 • 65 • 1

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 87 • 1

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 251 • 2

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 535 • 1

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated Nov 15, 2024 • 73 • 1

kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-2bit

Text Generation • Updated Nov 26, 2024 • 68 • 4

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15, 2024 • 74 • 7

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20, 2024 • 978k • 1

zachlandes/Mistral-Large-Instruct-2411-Q2-MLX

Updated Nov 21, 2024 • 13 • 1

HawkonLi/Hunyuan-A52B-Instruct-2bit

Text Generation • Updated Nov 26, 2024 • 17 • 1

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated Dec 3, 2024 • 736k • 3

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 57 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 173 • 2

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated Dec 6, 2024 • 471 • 1

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated Dec 6, 2024 • 88 • 1

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated about 1 month ago • 1.91M • 8

MaziyarPanahi/Pleias-Nano-GGUF

Text Generation • Updated about 1 month ago • 418 • 3

MaziyarPanahi/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • Updated 29 days ago • 348 • 1

MaziyarPanahi/EXAONE-3.5-7.8B-Instruct-GGUF

Text Generation • Updated 29 days ago • 232 • 1

MaziyarPanahi/EXAONE-3.5-32B-Instruct-GGUF

Text Generation • Updated 28 days ago • 250 • 1

MaziyarPanahi/Hermes-3-Llama-3.2-3B-GGUF

Text Generation • Updated 27 days ago • 556k • 1

MaziyarPanahi/MISCHIEVOUS-12B-GGUF

Text Generation • Updated 23 days ago • 156 • 1

MaziyarPanahi/nepoticide-12B-Unslop-Unleashed-Mell-RPMax-v2-GGUF

Text Generation • Updated 23 days ago • 162 • 1

MaziyarPanahi/ASR-Fixer-GGUF

Text Generation • Updated 23 days ago • 99 • 1

MaziyarPanahi/NekoMix-12B-GGUF

Text Generation • Updated 23 days ago • 134 • 1

MaziyarPanahi/Mistral-Nemo-Prism-12B-GGUF

Text Generation • Updated 23 days ago • 258 • 1

MaziyarPanahi/patricide-12B-Unslop-Mell-v2-GGUF

Text Generation • Updated 22 days ago • 214 • 2