Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

4-bit precision

text-generation-inference

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

213

Full-text search

Active filters: quantization

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 152

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 410 • 1

legraphista/Llama-Guard-3-1B-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 619

vhab10/llama_3.1_8b_Q4_K_M-gguf

Text Generation • Updated Oct 6, 2024

hagsaeng/MachinLearningBootCamp_QAclassifier_Gemma-2B

Text Classification • Updated Oct 3, 2024

ejbejaranos/Bitnet-LLama3-8B-Now2B

Updated Oct 7, 2024 • 7 • 3

mehdibukhari/llama3.18B-Fine-tunedByMehdi

Updated Oct 8, 2024

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10, 2024 • 15

mcavus/glm-4v-9b-gptq-4bit-dynamo

Updated Oct 10, 2024 • 3 • 1

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13, 2024 • 68

AshutoshAdhikari/rsclf-scibert-improved

Text Classification • Updated Nov 27, 2024 • 104

harishnair04/Gemma-medtr-2b-sft

Text Generation • Updated Nov 7, 2024 • 7

harishnair04/Gemma-medtr-2b-sft-v2

Text Generation • Updated Nov 15, 2024 • 10

mradermacher/Gemma-medtr-2b-sft-v2-GGUF

Updated Nov 16, 2024 • 49

neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic

Text Generation • Updated Dec 19, 2024 • 20

NbAiLab/nb-llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated Dec 11, 2024 • 13

NbAiLab/nb-llama-3.2-3B-Q4_K_M-GGUF

Text Generation • Updated Dec 11, 2024 • 26

NbAiLab/nb-llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Dec 11, 2024 • 56

neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16

Text Generation • Updated Dec 19, 2024 • 13

NbAiLab/nb-llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 11, 2024 • 9

NbAiLab/nb-llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 11, 2024 • 15

NbAiLab/nb-llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 11, 2024 • 16

cipherunhsiv/Llama-2-7b-chat-fine_tune

Text Generation • Updated Dec 5, 2024

yyyang/showui-2b-awq

Updated Dec 10, 2024 • 123

btaskel/RWKV6-7B-Chn-UnlimitedRP-chat-beta2-GGUF

Updated 20 days ago • 253 • 1

Satwik11/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit

Text Generation • Updated Dec 18, 2024 • 1.3k • 1

timiasuy/L3-8B-Lunaris-v1-awq-marlin

Updated 28 days ago • 47

btaskel/RWKV6-3B-v2.1-Aphrodite-yandere-chat-GGUF

Updated 21 days ago • 39

btaskel/RWKV6-3B-Chn-UnlimitedRP-mini-chat-GGUF

Updated 20 days ago • 359

exxocism/Linkbricks-Horizon-AI-Llama-3.3-Korean-70B-sft-dpo-GGUF

Text Generation • Updated 15 days ago