Hugging Face's logo

tensorblock
/
Qwen2.5-1.5B-Instruct-GGUF

Text Generation
Transformers
GGUF
English
chat
TensorBlock
GGUF
Inference Endpoints
conversational
Model card Files Community
morriszms commited on
Commit
2d2c3e2
·
verified ·
1 Parent(s): 6367fb0

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. Qwen2.5-1.5B-Instruct-Q2_K.gguf +2 -2
  2. Qwen2.5-1.5B-Instruct-Q3_K_L.gguf +2 -2
  3. Qwen2.5-1.5B-Instruct-Q3_K_M.gguf +2 -2
  4. Qwen2.5-1.5B-Instruct-Q3_K_S.gguf +2 -2
  5. Qwen2.5-1.5B-Instruct-Q4_0.gguf +2 -2
  6. Qwen2.5-1.5B-Instruct-Q4_K_M.gguf +2 -2
  7. Qwen2.5-1.5B-Instruct-Q4_K_S.gguf +2 -2
  8. Qwen2.5-1.5B-Instruct-Q5_0.gguf +2 -2
  9. Qwen2.5-1.5B-Instruct-Q5_K_M.gguf +2 -2
  10. Qwen2.5-1.5B-Instruct-Q5_K_S.gguf +2 -2
  11. Qwen2.5-1.5B-Instruct-Q6_K.gguf +2 -2
  12. Qwen2.5-1.5B-Instruct-Q8_0.gguf +2 -2
  13. README.md +9 -8
Qwen2.5-1.5B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:592ca957d2611c9f2f09e49f58e0efcd5014af097051a21ae90a487655232f0e
3
- size 676304832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14edbb5e781bd650b951cefa38bd30e9dc3220b46eb88b7bd0891cdbe52e7c0b
3
+ size 676304896
Qwen2.5-1.5B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8ad34ea22ab2f570fa85fb9dbb9a4459460549134a015e93467b122b1ea72b75
3
- size 880162752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:351d8230feda1b49c15ffa2f9f27d8999246bddf33d3affaf912ce362ff0b0eb
3
+ size 880162816
Qwen2.5-1.5B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0faf3f8e4ac66dd9a02e91bdbeb8534ac033da82ee0775241558a03cf5039a3f
3
- size 824178624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df4b4184f3dfd702341bd3e6951bdeb3f623cfa82ea06cdece0e2df274c2bdea
3
+ size 824178688
Qwen2.5-1.5B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf603322df91ef82fd78fe5dc3a8daeb364f8661fc5efe20b571a3013c92c12d
3
- size 760944576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf785a60ce8583b6cab56628759e6f92cc067555775f890cfa0a2b44e4650992
3
+ size 760944640
Qwen2.5-1.5B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b46378a38c14250f322682f6eb8ff1147e13c97e43eaf13dac2a115ecadb1639
3
- size 934954944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:218f9a02a086c79b1d9644fbd424374ccb9c61a15717d6d6066d892d11e63bd0
3
+ size 934955008
Qwen2.5-1.5B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4643c079a434d38ce7472577373104ee0851bb892786d4684f22f25c89acc167
3
- size 986048448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fd63b22b5ee6bf544c89fd561e94c0771e1625f33e052d0a94ee010d8f5fea1
3
+ size 986048512
Qwen2.5-1.5B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6f34dbbefdd5e01831587f13114cbb6ef127aefa5a127d22bd9ccf2e6d2a0a96
3
- size 940312512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b8652793c1ca5729882924d0b3e4f185a850e6454ac8df356d983bc758463da
3
+ size 940312576
Qwen2.5-1.5B-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:eecff63427383049ce9c87d8dbbd439e72859f86b87eb1b83bce3272b297ab16
3
- size 1098729408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59a5289b91e11edf11678d29ee403e36113e707ec7118c716eb350b8f53c3cae
3
+ size 1098729472
Qwen2.5-1.5B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bbaf82e161b6579cd307dc2720763ceb35a6e74c6ebe625418b292b5ea13f6d2
3
- size 1125050304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7b2f02b2032eaf20c52e04f5cf9d7a63955c3b11d0d9e4ae4cf8db74df4b796
3
+ size 1125050368
Qwen2.5-1.5B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b3c534efac94d3c677ce513b722af3b91cbf51302fb391fddd0fc59a2f8544cf
3
- size 1098729408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41c61f078726046c85ea52663680d1bb2b3228beb90230941b727e712b549c70
3
+ size 1098729472
Qwen2.5-1.5B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6c031fb09af17129aa73bd7c9f1542f86411375f6340dee831dbac28ea28291
3
- size 1272739776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c232b1afbbe997635dfaa8830669bb84c8a7a998288ceee4347a0123ff1b4237
3
+ size 1272739840
Qwen2.5-1.5B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5542aabf41e558ac36fcb56b8d00919607ed2227de376d435ecad04834264f3f
3
- size 1646572992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1bbc25c2c8e5553f050ae5b95ac1685eda503d94bf405c5114dfc317f18c8235
3
+ size 1646573056
README.md CHANGED
@@ -1,14 +1,15 @@
1
  ---
2
- base_model: unsloth/Qwen2.5-1.5B-Instruct
 
3
  language:
4
  - en
5
- library_name: transformers
6
- license: apache-2.0
7
  tags:
8
- - unsloth
9
- - transformers
10
  - TensorBlock
11
  - GGUF
 
12
  ---
13
 
14
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -22,11 +23,11 @@ tags:
22
  </div>
23
  </div>
24
 
25
- ## unsloth/Qwen2.5-1.5B-Instruct - GGUF
26
 
27
- This repo contains GGUF format model files for [unsloth/Qwen2.5-1.5B-Instruct](https://huggingface.co/unsloth/Qwen2.5-1.5B-Instruct).
28
 
29
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
31
  <div style="text-align: left; margin: 20px 0;">
32
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
1
  ---
2
+ license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct/blob/main/LICENSE
4
  language:
5
  - en
6
+ pipeline_tag: text-generation
7
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
8
  tags:
9
+ - chat
 
10
  - TensorBlock
11
  - GGUF
12
+ library_name: transformers
13
  ---
14
 
15
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
23
  </div>
24
  </div>
25
 
26
+ ## Qwen/Qwen2.5-1.5B-Instruct - GGUF
27
 
28
+ This repo contains GGUF format model files for [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct).
29
 
30
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit ec7f3ac](https://github.com/ggerganov/llama.cpp/commit/ec7f3ac9ab33e46b136eb5ab6a76c4d81f57c7f1).
31
 
32
  <div style="text-align: left; margin: 20px 0;">
33
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">