ArkaAbacus
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -3,9 +3,13 @@ library_name: transformers
|
|
3 |
tags: []
|
4 |
---
|
5 |
|
6 |
-
|
7 |
|
8 |
-
|
|
|
|
|
|
|
|
|
9 |
|
10 |
|
11 |
|
|
|
3 |
tags: []
|
4 |
---
|
5 |
|
6 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/pf4d6FA7DriRtVq5HCkxd.png)
|
7 |
|
8 |
+
# Llama-3-Giraffe-70B
|
9 |
+
|
10 |
+
Abacus.AI presents our longer-necked variant of Llama 3 70B!
|
11 |
+
|
12 |
+
This model has an effective context length of approximately 128k. It has been trained on samples taken from the [RedPajama](https://github.com/togethercomputer/RedPajama-Data) using [PoSE](https://arxiv.org/abs/2309.10400)
|
13 |
|
14 |
|
15 |
|