Edit Models filters

Model Tree

Qwen/Qwen2.5-32B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

122

Full-text search

Active filters: Qwen/Qwen2.5-32B-Instruct

mradermacher/Qwen2.5-32B-Instruct-GGUF

Updated 24 days ago • 657

mradermacher/Qwen2.5-32B-Instruct-i1-GGUF

Updated 24 days ago • 969 • 1

hewengao/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 27, 2024 • 1

jacobcarajo/Qwen2.5-32B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 4

VPTQ-community/Qwen2.5-32B-Instruct-v16-k65536-65536-woft

Updated Nov 18, 2024 • 2 • 1

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-0-woft

Updated Nov 18, 2024 • 18

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft

Updated Nov 18, 2024 • 10

VPTQ-community/Qwen2.5-32B-Instruct-v8-k256-256-woft

Updated Nov 18, 2024 • 4

VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-256-woft

Updated Nov 18, 2024 • 5 • 2

WPAI-INC/WPAIGPT-fse-patterns-1

Text Generation • Updated Oct 9, 2024 • 134

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-4.65bpw-exl2

Text Generation • Updated Oct 12, 2024 • 7

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-6.5bpw-exl2

Text Generation • Updated Oct 12, 2024 • 16 • 1

zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-8.0bpw-exl2

Text Generation • Updated Oct 12, 2024 • 7

cksghl1004/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 14, 2024 • 6

noxinc/Qwen2.5-32B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 15, 2024 • 3

Jellon/Qwen2.5-32B-Instruct-abliterated-exl2-4bpw

Text Generation • Updated Oct 19, 2024 • 19

mav23/Rombos-LLM-V2.5-Qwen-32b-GGUF

Updated Oct 20, 2024 • 153

mav23/Qwen2.5-32B-AGI-GGUF

Updated Oct 23, 2024 • 520

jth01/Rombos-LLM-V2.5-Qwen-32b-4.0bpw-exl2

Text Generation • Updated Oct 24, 2024 • 6

KnutJaegersberg/CompassJudger-1-32B-Instruct-exl2-8.0bpw

Updated Oct 26, 2024 • 5

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_5.0bpw

Text Generation • Updated Oct 27, 2024 • 6

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_4.0bpw

Text Generation • Updated Oct 27, 2024 • 6

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_4.5bpw

Text Generation • Updated Oct 27, 2024 • 6

FelixSAG/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 4, 2024 • 3

lmstudio-community/Qwen2.5-32B-Instruct-MLX-4bit

Text Generation • Updated Nov 13, 2024 • 164 • 1

lmstudio-community/Qwen2.5-32B-Instruct-MLX-8bit

Text Generation • Updated Nov 13, 2024 • 90

cmarkea/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated Nov 14, 2024 • 22 • 2

mav23/CompassJudger-1-32B-Instruct-GGUF

Updated Nov 15, 2024 • 61

nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic

Updated Nov 15, 2024 • 277 • 1

Daemonrat/Qwen2.5-32B-AGI_Q4_K_M

Updated Nov 15, 2024 • 2