Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,968

Full-text search

Active filters: 3-bit

MaziyarPanahi/relay-v0.1-Mistral-Nemo-2407-GGUF

Text Generation • Updated 16 days ago • 139

Jellon/Anubis-70B-v1-exl2-3bpw

Updated 15 days ago • 19

reach-vb/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • Updated 15 days ago • 7

cnfusion/QwQ-32B-Coder-Fusion-8020-Q3-mlx

Text Generation • Updated 15 days ago • 10

Dracones/Anubis-70B-v1_exl2_3.0bpw

Text Generation • Updated 15 days ago • 15

cnfusion/QwQ-32B-Coder-Fusion-7030-Q3-mlx

Text Generation • Updated 14 days ago • 11

cnfusion/Microsoft_Phi-4-mlx-3bit

Text Generation • Updated 14 days ago • 7

yz1129/mlx-breeze-2bit

Updated 13 days ago • 1

ubaitur5/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • Updated 13 days ago • 1

Dracones/QVQ-72B-Preview_exl2_3.0bpw

Image-Text-to-Text • Updated 13 days ago

mlx-community/twllama

Updated 13 days ago • 4

bullerwins/QVQ-72B-Preview-exl2_3.0bpw

Image-Text-to-Text • Updated 13 days ago • 3

MaziyarPanahi/DarkCamelot_2-GGUF

Text Generation • Updated 13 days ago • 131

MaziyarPanahi/Mistral-Nemo-VICIOUS_MESH-12B-2407-GGUF

Text Generation • Updated 13 days ago • 128

MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF

Text Generation • Updated 13 days ago • 120

MaziyarPanahi/VICIOUS_MESH-12B-BETA-GGUF

Text Generation • Updated 13 days ago • 120

MaziyarPanahi/Captain_BMO-0.420-Magnum-12B-GGUF

Text Generation • Updated 13 days ago • 108

MaziyarPanahi/Captain-Eris_Twighlight-V0.420-12B-GGUF

Text Generation • Updated 11 days ago • 114

MaziyarPanahi/Kosmos-EVAA-Fusion-light-8B-GGUF

Text Generation • Updated 11 days ago • 111

MaziyarPanahi/Kosmos-EVAA-v9-8B-GGUF

Text Generation • Updated 11 days ago • 115

MaziyarPanahi/Kosmos-Elusive-VENN-Aurora_faustus-8B-GGUF

Text Generation • Updated 11 days ago • 106

MaziyarPanahi/Kosmos-VENN-8B-GGUF

Text Generation • Updated 11 days ago • 150

MaziyarPanahi/stackexchange_movies-GGUF

Text Generation • Updated 11 days ago • 113

MaziyarPanahi/ZEUS-8B-V10-GGUF

Text Generation • Updated 11 days ago • 117

MaziyarPanahi/Tulu-MathLingo-8B-GGUF

Text Generation • Updated 11 days ago • 95

ubaitur5/Qwen2.5-Coder-7B-Instruct-Q3-mlx

Text Generation • Updated 9 days ago • 7

MaziyarPanahi/Llama-Deepsync-1B-GGUF

Text Generation • Updated 9 days ago • 117

MaziyarPanahi/Llama-Deepsync-3B-GGUF

Text Generation • Updated 9 days ago • 117

MaziyarPanahi/Kosmos-EVAA-TSN-light-8B-GGUF

Text Generation • Updated 9 days ago • 115

MaziyarPanahi/Kosmos-EVAA-gamma-light-8B-GGUF

Text Generation • Updated 9 days ago • 117