v000000 commited on
Commit
ae775df
·
verified ·
1 Parent(s): 42d3f91

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -2
README.md CHANGED
@@ -10,5 +10,18 @@ tags:
10
 
11
  ![d48ca23f-9063-4a66-a6b8-0abcbfe26dc5.jpg](https://cdn-uploads.huggingface.co/production/uploads/64f74b6e6389380c77562762/96he_28zzbVZBoh29QlIm.jpeg)
12
 
13
- This is a test, <b>"v000000/L3.1-Niitorm-8B-t0.0001"</b> but merged one extra time with <b>"akjindal53244/Llama-3.1-Storm-8B"</b>. Using a new merging algorithm I wrote "LATCOS", which is non linear interpolation and cosine vector similarity between tensors in both magnitude and direction.
14
- This attempts to find the smoothest possible interpolation and make them work more seamlessly together by taking into account the vector direction where both models agree. Seems a lot smarter, but also more compliant which could be a negative since it's less dynamic.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
  ![d48ca23f-9063-4a66-a6b8-0abcbfe26dc5.jpg](https://cdn-uploads.huggingface.co/production/uploads/64f74b6e6389380c77562762/96he_28zzbVZBoh29QlIm.jpeg)
12
 
13
+ # Ordered by quality:
14
+ * q8_0 imatrix
15
+ * q8_0
16
+ * q6_k imatrix
17
+ * q6_k
18
+ * q5_k_m imatrix
19
+ * q5_k_s imatrix
20
+ * q4_k_m imatrix
21
+ * q4_k_s imatrix
22
+ * iq4_xs imatrix
23
+ * q4_0_4_8 imatrix arm
24
+ * q4_0_4_4 imatrix arm
25
+
26
+ This is a test, <b>"v000000/L3.1-Niitorm-8B-t0.0001"</b> but merged one extra time with <b>"akjindal53244/Llama-3.1-Storm-8B"</b>. Using a new merging algorithm I wrote <b>"LATCOS"</b>, which is non linear interpolation and cosine vector similarity between tensors in both magnitude and direction.
27
+ This attempts to find the smoothest possible interpolation and make them work more seamlessly together by taking into account the vector direction where both models agree. The model seems a lot smarter even though it's just a bit more of storm, but also more compliant which could be a negative since it's less dynamic.