Hugging Face's logo

second-state
/
ChatAllInOne-Yi-34B-200K-V1-GGUF

Text Generation
Transformers
GGUF
llama
Inference Endpoints
Model card Files Community
Xin Liu commited on
Commit
e09cd12
·
1 Parent(s): e3fd4ff

Add models

Browse files

Signed-off-by: Xin Liu <[email protected]>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. ChatAllInOne-Yi-34B-200K-V1-Q2_K.gguf +3 -0
  3. ChatAllInOne-Yi-34B-200K-V1-Q3_K_L.gguf +3 -0
  4. ChatAllInOne-Yi-34B-200K-V1-Q3_K_M.gguf +3 -0
  5. ChatAllInOne-Yi-34B-200K-V1-Q3_K_S.gguf +3 -0
  6. ChatAllInOne-Yi-34B-200K-V1-Q4_0.gguf +3 -0
  7. ChatAllInOne-Yi-34B-200K-V1-Q4_K_M.gguf +3 -0
  8. ChatAllInOne-Yi-34B-200K-V1-Q4_K_S.gguf +3 -0
  9. ChatAllInOne-Yi-34B-200K-V1-Q5_0.gguf +3 -0
  10. ChatAllInOne-Yi-34B-200K-V1-Q5_K_M.gguf +3 -0
  11. ChatAllInOne-Yi-34B-200K-V1-Q5_K_S.gguf +3 -0
  12. ChatAllInOne-Yi-34B-200K-V1-Q6_K.gguf +3 -0
  13. ChatAllInOne-Yi-34B-200K-V1-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
ChatAllInOne-Yi-34B-200K-V1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02dd7e2ab48f0f2371e4d7d58077905a62911ec896d2c10f3374ccb7635400de
3
+ size 12825233472
ChatAllInOne-Yi-34B-200K-V1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6101281d18fd78f0d60bfed4b67a54bb1bad5ba3672cbcc6451820b8e99eb31
3
+ size 18139445312
ChatAllInOne-Yi-34B-200K-V1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:553e866520bfaedea34a63abf5db39bc8396c7ecda0d78279048ac28638e3b27
3
+ size 16654923840
ChatAllInOne-Yi-34B-200K-V1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce8699c09ff85a88ba7859561ef4f87d4d3cf0f9307129be649af0d2127236a4
3
+ size 14960293952
ChatAllInOne-Yi-34B-200K-V1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e84acfcecff3ffd23e28552924724f3ee3d38b8d37f0dc9540c47b1464a3260
3
+ size 19466528832
ChatAllInOne-Yi-34B-200K-V1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73adb3356a36aba9c8b816e9fd39a3d7e5b738459546ef18974b719a20216981
3
+ size 20658710592
ChatAllInOne-Yi-34B-200K-V1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd20fe5a20ce64792d5d4620a7fd3655866be0102d78dc8b3d2a109f6cdb9f01
3
+ size 19598649408
ChatAllInOne-Yi-34B-200K-V1-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec8b32859acb4f25f4752175d7f137b9115234398e23dbb10e4f43181c06aa83
3
+ size 23707691072
ChatAllInOne-Yi-34B-200K-V1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e346fda5b6b3f75065985878e0424d1946ce8f60b4f04e55881ed06431352bb
3
+ size 24321845312
ChatAllInOne-Yi-34B-200K-V1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f45334970c93f8a78df464e4c4873874903481535dbb9a3299f103ee82185ee
3
+ size 23707691072
ChatAllInOne-Yi-34B-200K-V1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d3a1fb7d3d03bf0ab3fef1e46ad86e66cbf6adc4c107628970f2e8ec0a50ef5
3
+ size 28213925952
ChatAllInOne-Yi-34B-200K-V1-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ebfea5d0504de12cfe42e119541cbe1a89d69533d7fe2bd5d1dce6cda0c36e4
3
+ size 36542281792