Update README.md
Browse files
README.md
CHANGED
|
@@ -8,5 +8,7 @@ tags:
|
|
| 8 |
|
| 9 |
# Llama-3.1-Niitorm-8B-LATCOSx2
|
| 10 |
|
|
|
|
|
|
|
| 11 |
This is a test, <b>"v000000/L3.1-Niitorm-8B-t0.0001"</b> but merged one extra time with <b>"akjindal53244/Llama-3.1-Storm-8B"</b>. Using a new merging algorithm I wrote "LATCOS", which is non linear interpolation and cosine vector similarity between tensors in both magnitude and direction.
|
| 12 |
This attempts to find the smoothest possible interpolation and make them work more seamlessly together by taking into account the vector direction where both models agree. Seems a lot smarter, but also more compliant which could be a negative since it's less dynamic.
|
|
|
|
| 8 |
|
| 9 |
# Llama-3.1-Niitorm-8B-LATCOSx2
|
| 10 |
|
| 11 |
+
|
| 12 |
+
|
| 13 |
This is a test, <b>"v000000/L3.1-Niitorm-8B-t0.0001"</b> but merged one extra time with <b>"akjindal53244/Llama-3.1-Storm-8B"</b>. Using a new merging algorithm I wrote "LATCOS", which is non linear interpolation and cosine vector similarity between tensors in both magnitude and direction.
|
| 14 |
This attempts to find the smoothest possible interpolation and make them work more seamlessly together by taking into account the vector direction where both models agree. Seems a lot smarter, but also more compliant which could be a negative since it's less dynamic.
|