leaderboard-pr-bot
commited on
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
@@ -1,13 +1,116 @@
|
|
1 |
---
|
|
|
|
|
2 |
license: apache-2.0
|
|
|
3 |
tags:
|
4 |
- moe
|
5 |
- merge
|
6 |
- abideen/NexoNimbus-7B
|
7 |
- mlabonne/NeuralMarcoro14-7B
|
8 |
-
|
9 |
-
-
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
---
|
12 |
|
13 |
# NexoNimbus-MoE-2x7B
|
@@ -117,4 +220,17 @@ outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7,
|
|
117 |
print(outputs[0]["generated_text"])
|
118 |
```
|
119 |
|
120 |
-
"Data science is an interdisciplinary field that combines mathematics, statistics, computer science, and domain expertise in order to extract meaningful insights and knowledge from structured and unstructured data. It involves the process of collecting, cleaning, transforming, analyzing, and visualizing data in order to identify patterns, trends, and relationships that can inform decision-making and drive business strategies. Data scientists use various tools and techniques, such as machine learning, deep learning, and natural language processing, to develop predictive models, optimize processes, and automate decision-making. The field of data science is rapidly evolving as more and more data is generated and the demand for data-driven insights continues to grow."
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
license: apache-2.0
|
5 |
+
library_name: transformers
|
6 |
tags:
|
7 |
- moe
|
8 |
- merge
|
9 |
- abideen/NexoNimbus-7B
|
10 |
- mlabonne/NeuralMarcoro14-7B
|
11 |
+
model-index:
|
12 |
+
- name: NexoNimbus-MoE-2x7B
|
13 |
+
results:
|
14 |
+
- task:
|
15 |
+
type: text-generation
|
16 |
+
name: Text Generation
|
17 |
+
dataset:
|
18 |
+
name: AI2 Reasoning Challenge (25-Shot)
|
19 |
+
type: ai2_arc
|
20 |
+
config: ARC-Challenge
|
21 |
+
split: test
|
22 |
+
args:
|
23 |
+
num_few_shot: 25
|
24 |
+
metrics:
|
25 |
+
- type: acc_norm
|
26 |
+
value: 66.81
|
27 |
+
name: normalized accuracy
|
28 |
+
source:
|
29 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=abideen/NexoNimbus-MoE-2x7B
|
30 |
+
name: Open LLM Leaderboard
|
31 |
+
- task:
|
32 |
+
type: text-generation
|
33 |
+
name: Text Generation
|
34 |
+
dataset:
|
35 |
+
name: HellaSwag (10-Shot)
|
36 |
+
type: hellaswag
|
37 |
+
split: validation
|
38 |
+
args:
|
39 |
+
num_few_shot: 10
|
40 |
+
metrics:
|
41 |
+
- type: acc_norm
|
42 |
+
value: 85.66
|
43 |
+
name: normalized accuracy
|
44 |
+
source:
|
45 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=abideen/NexoNimbus-MoE-2x7B
|
46 |
+
name: Open LLM Leaderboard
|
47 |
+
- task:
|
48 |
+
type: text-generation
|
49 |
+
name: Text Generation
|
50 |
+
dataset:
|
51 |
+
name: MMLU (5-Shot)
|
52 |
+
type: cais/mmlu
|
53 |
+
config: all
|
54 |
+
split: test
|
55 |
+
args:
|
56 |
+
num_few_shot: 5
|
57 |
+
metrics:
|
58 |
+
- type: acc
|
59 |
+
value: 64.51
|
60 |
+
name: accuracy
|
61 |
+
source:
|
62 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=abideen/NexoNimbus-MoE-2x7B
|
63 |
+
name: Open LLM Leaderboard
|
64 |
+
- task:
|
65 |
+
type: text-generation
|
66 |
+
name: Text Generation
|
67 |
+
dataset:
|
68 |
+
name: TruthfulQA (0-shot)
|
69 |
+
type: truthful_qa
|
70 |
+
config: multiple_choice
|
71 |
+
split: validation
|
72 |
+
args:
|
73 |
+
num_few_shot: 0
|
74 |
+
metrics:
|
75 |
+
- type: mc2
|
76 |
+
value: 53.06
|
77 |
+
source:
|
78 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=abideen/NexoNimbus-MoE-2x7B
|
79 |
+
name: Open LLM Leaderboard
|
80 |
+
- task:
|
81 |
+
type: text-generation
|
82 |
+
name: Text Generation
|
83 |
+
dataset:
|
84 |
+
name: Winogrande (5-shot)
|
85 |
+
type: winogrande
|
86 |
+
config: winogrande_xl
|
87 |
+
split: validation
|
88 |
+
args:
|
89 |
+
num_few_shot: 5
|
90 |
+
metrics:
|
91 |
+
- type: acc
|
92 |
+
value: 81.53
|
93 |
+
name: accuracy
|
94 |
+
source:
|
95 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=abideen/NexoNimbus-MoE-2x7B
|
96 |
+
name: Open LLM Leaderboard
|
97 |
+
- task:
|
98 |
+
type: text-generation
|
99 |
+
name: Text Generation
|
100 |
+
dataset:
|
101 |
+
name: GSM8k (5-shot)
|
102 |
+
type: gsm8k
|
103 |
+
config: main
|
104 |
+
split: test
|
105 |
+
args:
|
106 |
+
num_few_shot: 5
|
107 |
+
metrics:
|
108 |
+
- type: acc
|
109 |
+
value: 53.53
|
110 |
+
name: accuracy
|
111 |
+
source:
|
112 |
+
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=abideen/NexoNimbus-MoE-2x7B
|
113 |
+
name: Open LLM Leaderboard
|
114 |
---
|
115 |
|
116 |
# NexoNimbus-MoE-2x7B
|
|
|
220 |
print(outputs[0]["generated_text"])
|
221 |
```
|
222 |
|
223 |
+
"Data science is an interdisciplinary field that combines mathematics, statistics, computer science, and domain expertise in order to extract meaningful insights and knowledge from structured and unstructured data. It involves the process of collecting, cleaning, transforming, analyzing, and visualizing data in order to identify patterns, trends, and relationships that can inform decision-making and drive business strategies. Data scientists use various tools and techniques, such as machine learning, deep learning, and natural language processing, to develop predictive models, optimize processes, and automate decision-making. The field of data science is rapidly evolving as more and more data is generated and the demand for data-driven insights continues to grow."
|
224 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
225 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_abideen__NexoNimbus-MoE-2x7B)
|
226 |
+
|
227 |
+
| Metric |Value|
|
228 |
+
|---------------------------------|----:|
|
229 |
+
|Avg. |67.51|
|
230 |
+
|AI2 Reasoning Challenge (25-Shot)|66.81|
|
231 |
+
|HellaSwag (10-Shot) |85.66|
|
232 |
+
|MMLU (5-Shot) |64.51|
|
233 |
+
|TruthfulQA (0-shot) |53.06|
|
234 |
+
|Winogrande (5-shot) |81.53|
|
235 |
+
|GSM8k (5-shot) |53.53|
|
236 |
+
|