Hugging Face's logo

Lewdiculous
/
Eris-Prime-Punch-9B-GGUF-IQ-Imatrix

GGUF
roleplay
mistral
vision
multimodal
llava
Inference Endpoints
conversational
Model card Files Community
Lewdiculous commited on
Commit
2e1c727
·
verified ·
1 Parent(s): 01c772d

quantized model files

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. Eris-Prime-Punch-9B-F16.gguf +3 -0
  3. Eris-Prime-Punch-9B-IQ3_M-imat.gguf +3 -0
  4. Eris-Prime-Punch-9B-IQ3_S-imat.gguf +3 -0
  5. Eris-Prime-Punch-9B-IQ3_XXS-imat.gguf +3 -0
  6. Eris-Prime-Punch-9B-IQ4_XS-imat.gguf +3 -0
  7. Eris-Prime-Punch-9B-Q4_K_M-imat.gguf +3 -0
  8. Eris-Prime-Punch-9B-Q4_K_S-imat.gguf +3 -0
  9. Eris-Prime-Punch-9B-Q5_K_M-imat.gguf +3 -0
  10. Eris-Prime-Punch-9B-Q5_K_S-imat.gguf +3 -0
  11. Eris-Prime-Punch-9B-Q6_K-imat.gguf +3 -0
  12. Eris-Prime-Punch-9B-Q8_0-imat.gguf +3 -0
  13. imatrix-with-rp-data-ex.txt +0 -0
  14. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Eris-Prime-Punch-9B-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Eris-Prime-Punch-9B-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Eris-Prime-Punch-9B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Eris-Prime-Punch-9B-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Eris-Prime-Punch-9B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Eris-Prime-Punch-9B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Eris-Prime-Punch-9B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Eris-Prime-Punch-9B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Eris-Prime-Punch-9B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Eris-Prime-Punch-9B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Eris-Prime-Punch-9B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
47
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
Eris-Prime-Punch-9B-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab37c7cf1b16b0358bfcde2ba2bf84ff0bfdada6476225f10332a9149ccd077d
3
+ size 17974659520
Eris-Prime-Punch-9B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67648596b5c31d243c45be49578e06359a17bf1ab5b9ffb1de2200caa6004c1d
3
+ size 4064971232
Eris-Prime-Punch-9B-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44ea5d16d9bd37992ebffcdd1567c661b5d567ed9a17a5ed42af3f8bf8ea4dfb
3
+ size 3936848352
Eris-Prime-Punch-9B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27620a8e3199ebc6292fd1a697b0fd1b5791307de0d5ed8e197284b3c1bb5036
3
+ size 3497388512
Eris-Prime-Punch-9B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aecb4124d30473158db36e38ca02dfd6da73030ad35552aa2d2717f24b8122ef
3
+ size 4840139232
Eris-Prime-Punch-9B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32ff496970021dea680d9b404f096d9861c668d5095a3d11616a6d7cfc80793d
3
+ size 5415053792
Eris-Prime-Punch-9B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a158c29419fac67e696c9002252fa8ee0dadef3818f187236c4feb6c9a6cb56
3
+ size 5129447904
Eris-Prime-Punch-9B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ef344297e4bce7d9ed32243e418076534cc3a23e8cfc8fffa654e495f338246
3
+ size 6364670432
Eris-Prime-Punch-9B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76211734937df2703859bd74286ac2f32176a43376bda4503b97e050a390dd7d
3
+ size 6197553632
Eris-Prime-Punch-9B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3e05a8d600da2af745c9c30ee566ff77a8172453903c77c97007773b4dd74a3
3
+ size 7373638112
Eris-Prime-Punch-9B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e873b450b541fa0b64dec2bc47571efbcaab3e070054224411a2b156dcb68fba
3
+ size 9550006752
imatrix-with-rp-data-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4f1b60e765c7ece19fdbf13964b455091b3eef32aec416a2822ba1aeb5568a1
3
+ size 6235174