Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ThomasBaruzier
/
Qwen2.5-3B-Instruct-GGUF
like
0
Text Generation
GGUF
English
chat
Inference Endpoints
conversational
arxiv:
2407.10671
License:
qwen-research
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Qwen2.5-3B-Instruct-GGUF
Commit History
Update README.md
2389dba
verified
ThomasBaruzier
commited on
Sep 19, 2024
Update README.md
b11bd0f
verified
ThomasBaruzier
commited on
Sep 19, 2024
Create README.md
0d1aeea
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q4_0_8_8.gguf
744908f
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q4_0_4_8.gguf
e682e38
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q4_0_4_4.gguf
5b45b93
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q8_0.gguf
c1aadc4
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q5_1.gguf
56e1602
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q5_0.gguf
1d60cf1
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q4_1.gguf
aea12b7
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q4_0.gguf
c250af4
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-F16.gguf
0c2d05c
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q6_K.gguf
fffdcd9
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q5_K_M.gguf
44d51a2
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q5_K_S.gguf
89e1de9
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ4_XS.gguf
e2c942d
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q4_K_S.gguf
15a0937
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ4_NL.gguf
b1c3a5e
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q4_K_M.gguf
e2ea540
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ3_XS.gguf
be67f4a
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q3_K_M.gguf
9374c21
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ3_S.gguf
570b138
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ3_M.gguf
7be5d4f
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ3_XXS.gguf
4de19df
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q3_K_L.gguf
83aefa8
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q3_K_S.gguf
02bdf41
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ2_M.gguf
50e607c
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q2_K.gguf
9ac10c8
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ2_XXS.gguf
6dcda30
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-Q2_K_S.gguf
43dcd54
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ2_XS.gguf
81c0495
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ2_S.gguf
8cba0aa
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ1_S.gguf
8642287
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload Qwen2.5-3B-Instruct-IQ1_M.gguf
fce5921
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload perplexity.md
3d594e3
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload imatrix.dat
f0c5e6c
verified
ThomasBaruzier
commited on
Sep 19, 2024
Upload calibration_datav3.txt
a7c8e8c
verified
ThomasBaruzier
commited on
Sep 19, 2024
initial commit
5020c73
verified
ThomasBaruzier
commited on
Sep 19, 2024
ThomasBaruzier
commited on
