Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-32B-Instruct-GGUF
like
1
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
2
Use this model
refs/pr/1
Qwen2.5-32B-Instruct-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
2f3515fa972cbd915f73ed7f4df1fc5975a1ec212112933654b40c44a1e7dca7
1c8e0c3
verified
4 months ago
.gitattributes
Safe
2.55 kB
2f3515fa972cbd915f73ed7f4df1fc5975a1ec212112933654b40c44a1e7dca7
4 months ago
Qwen2.5-32B-Instruct.IQ1_M.gguf
Safe
7.93 GB
LFS
aaeb4bf11f95acbc2e19d86d14af8b8f728111557f96e4ef799614498e9005c0
4 months ago
Qwen2.5-32B-Instruct.IQ1_S.gguf
Safe
7.27 GB
LFS
3248a7b25f72e87da45733a1a2263717a0615c6e7bec7e682492eac3f0d4e1ef
4 months ago
Qwen2.5-32B-Instruct.IQ2_XS.gguf
Safe
9.96 GB
LFS
35148a86f0568b51f126100f6379f41238907bdd974c6a13118bdb402a1d13b7
4 months ago
Qwen2.5-32B-Instruct.IQ3_XS.gguf
Safe
13.7 GB
LFS
b3918b8d20d488e6cbf30cbf709b111452acc65e03b81285e0122a374bea119c
4 months ago
Qwen2.5-32B-Instruct.IQ4_XS.gguf
Safe
17.7 GB
LFS
b8e70493ace5b55c366238a210e8df03bd3693a88d3428a3cd66425f021bd5c5
4 months ago
Qwen2.5-32B-Instruct.Q2_K.gguf
Safe
12.3 GB
LFS
550bccf2792320abd9e81ae75f238a7fd367f5bbbf4a9985fbd1fe5d47b870b1
4 months ago
Qwen2.5-32B-Instruct.Q3_K_L.gguf
Safe
17.2 GB
LFS
e8ec2e76016cca6e099077ae13e9929501f72689e01ac9284a346cfa0cb18e25
4 months ago
Qwen2.5-32B-Instruct.Q3_K_M.gguf
Safe
15.9 GB
LFS
82f12b3d54656a4446ec7942a78f47961eae679ce0b905bad8bc141e44a9257a
4 months ago
Qwen2.5-32B-Instruct.Q3_K_S.gguf
Safe
14.4 GB
LFS
aee69bda668bcc33fddd8bb8e4648a92afec583209966b76fc6886d297ef6fd5
4 months ago
Qwen2.5-32B-Instruct.Q4_K_M.gguf
Safe
19.9 GB
LFS
f3b88ef9c11155b0b120829dbacafa1338e7f07432b920ed7216807a903655c4
4 months ago
Qwen2.5-32B-Instruct.Q4_K_S.gguf
Safe
18.8 GB
LFS
8a68028c8ea5e0c5711fcc0479a15c96a9e3b0c3a8b6d2087556095f7a3f731e
4 months ago
Qwen2.5-32B-Instruct.Q5_K_M.gguf
Safe
23.3 GB
LFS
2e97db159afc5def76843b22d14a712ca42cb5c20918ad1f28744e786632aea3
4 months ago
Qwen2.5-32B-Instruct.Q5_K_S.gguf
Safe
22.6 GB
LFS
8b59e8d3bc1e2f6cb5508e6db1fd92dd75bc6d501706cfd87ef3cde1998af9df
4 months ago
Qwen2.5-32B-Instruct.Q6_K.gguf
Safe
26.9 GB
LFS
d0624a12161790b71066d9a8524d1adf7a78bda21e7ea419d6fd2dccbd5bf05e
4 months ago
Qwen2.5-32B-Instruct.Q8_0.gguf
Safe
34.8 GB
LFS
2f3515fa972cbd915f73ed7f4df1fc5975a1ec212112933654b40c44a1e7dca7
4 months ago
