Update README.md
Browse files
README.md
CHANGED
@@ -10,5 +10,18 @@ tags:
|
|
10 |
|
11 |
![d48ca23f-9063-4a66-a6b8-0abcbfe26dc5.jpg](https://cdn-uploads.huggingface.co/production/uploads/64f74b6e6389380c77562762/96he_28zzbVZBoh29QlIm.jpeg)
|
12 |
|
13 |
-
|
14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
|
11 |
![d48ca23f-9063-4a66-a6b8-0abcbfe26dc5.jpg](https://cdn-uploads.huggingface.co/production/uploads/64f74b6e6389380c77562762/96he_28zzbVZBoh29QlIm.jpeg)
|
12 |
|
13 |
+
# Ordered by quality:
|
14 |
+
* q8_0 imatrix
|
15 |
+
* q8_0
|
16 |
+
* q6_k imatrix
|
17 |
+
* q6_k
|
18 |
+
* q5_k_m imatrix
|
19 |
+
* q5_k_s imatrix
|
20 |
+
* q4_k_m imatrix
|
21 |
+
* q4_k_s imatrix
|
22 |
+
* iq4_xs imatrix
|
23 |
+
* q4_0_4_8 imatrix arm
|
24 |
+
* q4_0_4_4 imatrix arm
|
25 |
+
|
26 |
+
This is a test, <b>"v000000/L3.1-Niitorm-8B-t0.0001"</b> but merged one extra time with <b>"akjindal53244/Llama-3.1-Storm-8B"</b>. Using a new merging algorithm I wrote <b>"LATCOS"</b>, which is non linear interpolation and cosine vector similarity between tensors in both magnitude and direction.
|
27 |
+
This attempts to find the smoothest possible interpolation and make them work more seamlessly together by taking into account the vector direction where both models agree. The model seems a lot smarter even though it's just a bit more of storm, but also more compliant which could be a negative since it's less dynamic.
|