Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-32B-Instruct-GGUF
like
1
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
2
Use this model
9a945c4
Qwen2.5-32B-Instruct-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
b8e70493ace5b55c366238a210e8df03bd3693a88d3428a3cd66425f021bd5c5
9a945c4
verified
4 months ago
.gitattributes
1.86 kB
b8e70493ace5b55c366238a210e8df03bd3693a88d3428a3cd66425f021bd5c5
4 months ago
Qwen2.5-32B-Instruct.IQ1_M.gguf
7.93 GB
LFS
aaeb4bf11f95acbc2e19d86d14af8b8f728111557f96e4ef799614498e9005c0
4 months ago
Qwen2.5-32B-Instruct.IQ1_S.gguf
7.27 GB
LFS
3248a7b25f72e87da45733a1a2263717a0615c6e7bec7e682492eac3f0d4e1ef
4 months ago
Qwen2.5-32B-Instruct.IQ2_XS.gguf
9.96 GB
LFS
35148a86f0568b51f126100f6379f41238907bdd974c6a13118bdb402a1d13b7
4 months ago
Qwen2.5-32B-Instruct.IQ3_XS.gguf
13.7 GB
LFS
b3918b8d20d488e6cbf30cbf709b111452acc65e03b81285e0122a374bea119c
4 months ago
Qwen2.5-32B-Instruct.IQ4_XS.gguf
17.7 GB
LFS
b8e70493ace5b55c366238a210e8df03bd3693a88d3428a3cd66425f021bd5c5
4 months ago
