Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

9,857

Full-text search

Active filters: 8-bit

CalamitousFelicitousness/EVA-Qwen2.5-72B-v0.2-GPTQ-8Bit

Text Generation • Updated Nov 24, 2024 • 74 • 2

PrunaAI/schuler-experimental-JP47D20-bnb-8bit-smashed

Updated Dec 3, 2024 • 5 • 1

PrunaAI/schuler-experimental-JP47D21-KPhi-3-micro-4k-instruct-bnb-8bit-smashed

Updated Dec 4, 2024 • 5 • 1

mlx-community/Llama-3.1-Tulu-3-8B-8bit

Text Generation • Updated Nov 25, 2024 • 22 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_8.0bpw_h8

Updated Nov 26, 2024 • 29 • 1

Vikhrmodels/Vikhr-Qwen-2.5-1.5B-Instruct-MLX_8bit

Text Generation • Updated Nov 26, 2024 • 28 • 8

mlx-community/numind-NuExtract-1.5-MLX-8bit

Text Generation • Updated Nov 27, 2024 • 22 • 2

BigHuggyD/TheDrummer_Behemoth-123B-v2.1_exl2_8.0bpw_h8

Updated Nov 27, 2024 • 31 • 1

HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 41 • 1

HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 33 • 1

HuggingFaceTB/SmolLM2-135M-Instruct-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 42 • 2

Aktraiser/modele-test

Text Generation • Updated Nov 28, 2024 • 33 • 1

mlx-community/QwQ-32B-Preview-8bit

Text Generation • Updated Nov 27, 2024 • 191 • 5

Beygo/QwQ-32B-Preview-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 47 • 1

DrNicefellow/Qwen-QwQ-32B-Preview-8.0bpw-h8-exl2

Updated Nov 28, 2024 • 45 • 2

IlyaGusev/saiga_nemo_12b_gptq_8bit

Updated Nov 28, 2024 • 3.27k • 2

reinforce20001/SakuraLLM.Sakura-14B-Qwen2.5-v1.0-W8A8-Int8

Updated Nov 28, 2024 • 48 • 1

mlx-community/Qwen_QwQ-32B-Preview_MLX-8bit

Text Generation • Updated Nov 28, 2024 • 129 • 4

IlyaGusev/vikhr_nemo_12b_gptq_8bit

Text Generation • Updated Nov 29, 2024 • 240 • 1

EngineeringSoftware/exLong

Updated Nov 30, 2024 • 4 • 1

manohar25/Llama-3.2-3b-it-mental-health

Text Generation • Updated Dec 4, 2024 • 30 • 1

marquesafonso/NuExtract-openvino-8bit

Updated Dec 2, 2024 • 4 • 1

ivanfioravanti/oxy-1-small-mlx-8bit

Text Generation • Updated Dec 3, 2024 • 38 • 2

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated Dec 3, 2024 • 736k • 3

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 57 • 3

PrunaAI/Sakalti-model-3-bnb-8bit-smashed

Updated Dec 4, 2024 • 7 • 1

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 173 • 2

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_8.0bpw_h8

Text Generation • Updated 29 days ago • 227 • 1

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated Dec 6, 2024 • 471 • 1

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated Dec 6, 2024 • 88 • 1