ArkaAbacus commited on
Commit
a0cda08
·
verified ·
1 Parent(s): 72875ba

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -3,9 +3,13 @@ library_name: transformers
3
  tags: []
4
  ---
5
 
6
- # Model Card for Model ID
7
 
8
- <!-- Provide a quick summary of what the model is/does. -->
 
 
 
 
9
 
10
 
11
 
 
3
  tags: []
4
  ---
5
 
6
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/pf4d6FA7DriRtVq5HCkxd.png)
7
 
8
+ # Llama-3-Giraffe-70B
9
+
10
+ Abacus.AI presents our longer-necked variant of Llama 3 70B!
11
+
12
+ This model has an effective context length of approximately 128k. It has been trained on samples taken from the [RedPajama](https://github.com/togethercomputer/RedPajama-Data) using [PoSE](https://arxiv.org/abs/2309.10400)
13
 
14
 
15