Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

30

Full-text search

Active filters: Llama-Cpp

prithivMLmods/Novaeus-Promptist-7B-Instruct-GGUF

Text Generation • Updated 25 days ago • 252 • 8

prithivMLmods/Llama-Doctor-3.2-3B-Instruct-GGUF

Text Generation • Updated 24 days ago • 4.97k • 11

bartowski/Llama-Doctor-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 18, 2024 • 367 • 1

prithivMLmods/Llama-Sentient-3.2-3B-Instruct

Text Generation • Updated 21 days ago • 87 • 10

prithivMLmods/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 24, 2024 • 1.88k • 10

QuantFactory/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 25, 2024 • 342 • 2

bartowski/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 26, 2024 • 488 • 3

prithivMLmods/Llama-Magpie-3.2-3B-Instruct

Text Generation • Updated 27 days ago • 191 • 7

QuantFactory/Llama-Magpie-3.2-3B-Instruct-GGUF

Text Generation • Updated about 1 month ago • 921 • 2

prithivMLmods/Acrux-500M-o1-Journey

Text Generation • Updated 12 days ago • 289 • 8

prithivMLmods/QwQ-LCoT-7B-Instruct-GGUF

Text Generation • Updated 17 days ago • 657 • 7

prithivMLmods/Llama-Doctor-3.2-3B-Instruct

Text Generation • Updated 17 days ago • 337 • 7

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 3

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 5

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Nov 19, 2024 • 8

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 19, 2024 • 3

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Nov 19, 2024 • 9

Triangle104/Llama-Doctor-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 19, 2024 • 5

prithivMLmods/Marco-o1-GGUF

Text Generation • Updated 27 days ago • 663 • 11

mradermacher/Llama-Sentient-3.2-3B-Instruct-GGUF

Updated Nov 28, 2024 • 175

mradermacher/Llama-Sentient-3.2-3B-Instruct-i1-GGUF

Updated Nov 28, 2024 • 214

prithivMLmods/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Text Generation • Updated 19 days ago • 1.71k • 10

mradermacher/Acrux-500M-o1-Journey-GGUF

Updated 24 days ago • 305

mradermacher/Acrux-500M-o1-Journey-i1-GGUF

Updated 24 days ago • 556

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated 17 days ago • 29

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 17 days ago • 33

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 17 days ago • 29

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 17 days ago • 30

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated 17 days ago • 29

Triangle104/Llama-Sentient-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 17 days ago • 21