Edit Models filters

Model Tree

Qwen/Qwen2.5-32B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

122

Full-text search

Active filters: Qwen/Qwen2.5-32B-Instruct

osllmai-community/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Nov 17, 2024 • 5

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_4.0bpw

Text Generation • Updated Nov 18, 2024 • 7

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_5.0bpw

Text Generation • Updated Nov 18, 2024 • 8 • 1

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Nov 29, 2024 • 5

DrNicefellow/Qwen-QwQ-32B-Preview-4.25bpw-exl2

Text Generation • Updated Nov 28, 2024 • 40 • 3

async0x42/QwQ-32B-Preview-exl2_3.5bpw

Text Generation • Updated Nov 29, 2024 • 7

async0x42/QwQ-32B-Preview-exl2_4.5bpw

Text Generation • Updated Nov 29, 2024 • 30 • 1

async0x42/QwQ-32B-Preview-exl2_5.0bpw

Text Generation • Updated Nov 29, 2024 • 5

OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc

Updated 9 days ago • 22 • 1

ThomasBaruzier/QwQ-32B-Preview-GGUF

Updated Dec 16, 2024 • 86 • 1

Dracones/Qwen2.5-32B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 1, 2024 • 7

Dracones/Qwen2.5-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024 • 4

Dracones/Qwen2.5-32B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 1, 2024 • 6

Dracones/Qwen2.5-32B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 1, 2024 • 5

Dracones/Qwen2.5-32B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 1, 2024 • 14

Dracones/Qwen2.5-32B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 1, 2024 • 5

numen-tech/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Dec 2, 2024

bullerwins/QwQ-32B-Preview-exl2_4.5bpw

Text Generation • Updated Dec 3, 2024 • 5

bullerwins/QwQ-32B-Preview-exl2_5.5bpw

Text Generation • Updated Dec 3, 2024 • 4

bullerwins/QwQ-32B-Preview-exl2_6.5bpw

Text Generation • Updated Dec 3, 2024 • 5

cphan-intersystems/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 12, 2024 • 1

ericliu2007/Qwen2.5-32B-Instruct-Q2_K-GGUF

Text Generation • Updated Dec 13, 2024 • 2

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-0cb1b

Text Generation • Updated Dec 18, 2024 • 1

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-104ce

Text Generation • Updated Dec 19, 2024 • 4

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-196c8

Text Generation • Updated Dec 19, 2024 • 2

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-8777b

Text Generation • Updated Dec 20, 2024 • 1

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-393a7

Text Generation • Updated Dec 20, 2024 • 2

Triangle104/Qwen2.5-32B-Instruct-Q3_K_S-GGUF

Text Generation • Updated 24 days ago • 24

Triangle104/Qwen2.5-32B-Instruct-Q3_K_M-GGUF

Text Generation • Updated 24 days ago • 26

Triangle104/Qwen2.5-32B-Instruct-Q3_K_L-GGUF

Text Generation • Updated 24 days ago • 28