Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-32B-Instruct-GGUF
like
1
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
2
Use this model
044453b
Qwen2.5-32B-Instruct-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
82f12b3d54656a4446ec7942a78f47961eae679ce0b905bad8bc141e44a9257a
044453b
verified
4 months ago
.gitattributes
2.07 kB
82f12b3d54656a4446ec7942a78f47961eae679ce0b905bad8bc141e44a9257a
4 months ago
Qwen2.5-32B-Instruct.IQ1_M.gguf
7.93 GB
LFS
aaeb4bf11f95acbc2e19d86d14af8b8f728111557f96e4ef799614498e9005c0
4 months ago
Qwen2.5-32B-Instruct.IQ1_S.gguf
7.27 GB
LFS
3248a7b25f72e87da45733a1a2263717a0615c6e7bec7e682492eac3f0d4e1ef
4 months ago
Qwen2.5-32B-Instruct.IQ2_XS.gguf
9.96 GB
LFS
35148a86f0568b51f126100f6379f41238907bdd974c6a13118bdb402a1d13b7
4 months ago
Qwen2.5-32B-Instruct.IQ3_XS.gguf
13.7 GB
LFS
b3918b8d20d488e6cbf30cbf709b111452acc65e03b81285e0122a374bea119c
4 months ago
Qwen2.5-32B-Instruct.IQ4_XS.gguf
17.7 GB
LFS
b8e70493ace5b55c366238a210e8df03bd3693a88d3428a3cd66425f021bd5c5
4 months ago
Qwen2.5-32B-Instruct.Q2_K.gguf
12.3 GB
LFS
550bccf2792320abd9e81ae75f238a7fd367f5bbbf4a9985fbd1fe5d47b870b1
4 months ago
Qwen2.5-32B-Instruct.Q3_K_L.gguf
17.2 GB
LFS
e8ec2e76016cca6e099077ae13e9929501f72689e01ac9284a346cfa0cb18e25
4 months ago
Qwen2.5-32B-Instruct.Q3_K_M.gguf
15.9 GB
LFS
82f12b3d54656a4446ec7942a78f47961eae679ce0b905bad8bc141e44a9257a
4 months ago
