louisbrulenaudet
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -11,9 +11,31 @@ license: apache-2.0
|
|
11 |
language:
|
12 |
- en
|
13 |
library_name: transformers
|
14 |
-
metrics:
|
15 |
-
- accuracy
|
16 |
pipeline_tag: text-generation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
---
|
18 |
<center><img src='https://i.imgur.com/0xFTuAX.png' width='450px'></center>
|
19 |
|
@@ -27,7 +49,7 @@ Pearl-7B-slerp is a merge of the following models using [LazyMergekit](https://c
|
|
27 |
|
28 |
The evaluation was performed using the HuggingFace Open LLM Leaderboard.
|
29 |
|
30 |
-
| Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|
31 |
|-------------------------------------------|------------|-------|-----------|-------|------------|------------|-------|--------------|
|
32 |
| **louisbrulenaudet/Pearl-7B-slerp** |**72.75** | 68.00 | 87.16 | 64.04 | 62.35 | 81.29 |**73.62**| 7.24 |
|
33 |
| mistralai/Mixtral-8x7B-Instruct-v0.1 | 72.62 | 70.22 | 87.63 | 71.16 | 64.58 | 81.37 | 60.73 | 46.7 |
|
|
|
11 |
language:
|
12 |
- en
|
13 |
library_name: transformers
|
|
|
|
|
14 |
pipeline_tag: text-generation
|
15 |
+
model-index:
|
16 |
+
- name: Pearl-7B-slerp
|
17 |
+
results:
|
18 |
+
- task:
|
19 |
+
type: text-generation
|
20 |
+
metrics:
|
21 |
+
- name: ARC
|
22 |
+
type: ARC
|
23 |
+
value: 68.00
|
24 |
+
- name: GSM8K
|
25 |
+
type: GSM8K
|
26 |
+
value: 73.62
|
27 |
+
- name: Winogrande
|
28 |
+
type: Winogrande
|
29 |
+
value: 68.00
|
30 |
+
- name: TruthfulQA
|
31 |
+
type: TruthfulQA
|
32 |
+
value: 62.35
|
33 |
+
- name: HellaSwag
|
34 |
+
type: HellaSwag
|
35 |
+
value: 87.16
|
36 |
+
source:
|
37 |
+
name: Open LLM Leaderboard
|
38 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
|
39 |
---
|
40 |
<center><img src='https://i.imgur.com/0xFTuAX.png' width='450px'></center>
|
41 |
|
|
|
49 |
|
50 |
The evaluation was performed using the HuggingFace Open LLM Leaderboard.
|
51 |
|
52 |
+
| Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | Params (B) |
|
53 |
|-------------------------------------------|------------|-------|-----------|-------|------------|------------|-------|--------------|
|
54 |
| **louisbrulenaudet/Pearl-7B-slerp** |**72.75** | 68.00 | 87.16 | 64.04 | 62.35 | 81.29 |**73.62**| 7.24 |
|
55 |
| mistralai/Mixtral-8x7B-Instruct-v0.1 | 72.62 | 70.22 | 87.63 | 71.16 | 64.58 | 81.37 | 60.73 | 46.7 |
|