Taishi-N324
commited on
Upload README.md
Browse files
README.md
CHANGED
@@ -68,20 +68,20 @@ Our Swallow-MS-7b-v0.1 model has undergone continuous pre-training from the Mist
|
|
68 |
|Model|Size|JHumanEval|HumanEval|
|
69 |
|---|---|---|---|
|
70 |
| | |pass@1|pass@1|
|
71 |
-
| CyberAgentLM2-7B |7B|
|
72 |
-
| Llama 2 |7B|
|
73 |
-
| japanese-stablelm-base-beta-7b|7B|
|
74 |
-
| japanese-stablelm-base-ja_vocab-beta-7b|7B|
|
75 |
-
| ELYZA-japanese-Llama-2-7b|7B|
|
76 |
-
| ELYZA-japanese-Llama-2-7b-fast|7B|
|
77 |
-
| youri-7b (base) |7B|
|
78 |
-
| Swallow-7b |7B|
|
79 |
-
| Swallow-7b-plus |7B|
|
80 |
-
| Qwen-7B |7B|
|
81 |
-
| nekomata-7b |7B|
|
82 |
-
| Mistral-7B-v0.1 |7B
|
83 |
-
| japanese-stablelm-base-gamma-7b|7B|
|
84 |
-
| Swallow-MS-7b-v0.1 |7B|
|
85 |
|
86 |
## Usage
|
87 |
|
|
|
68 |
|Model|Size|JHumanEval|HumanEval|
|
69 |
|---|---|---|---|
|
70 |
| | |pass@1|pass@1|
|
71 |
+
| CyberAgentLM2-7B |7B|0.0634|0.0756|
|
72 |
+
| Llama 2 |7B|0.1152|0.1378|
|
73 |
+
| japanese-stablelm-base-beta-7b|7B|0.1018|0.1280|
|
74 |
+
| japanese-stablelm-base-ja_vocab-beta-7b|7B|0.0896|0.1122|
|
75 |
+
| ELYZA-japanese-Llama-2-7b|7B|0.0287|0.0427|
|
76 |
+
| ELYZA-japanese-Llama-2-7b-fast|7B| 0.0000 |0.0037|
|
77 |
+
| youri-7b (base) |7B|0.0829|0.0982|
|
78 |
+
| Swallow-7b |7B|0.0183|0.0183|
|
79 |
+
| Swallow-7b-plus |7B| 0.0061|0.0037|
|
80 |
+
| Qwen-7B |7B|0.1701|0.1805|
|
81 |
+
| nekomata-7b |7B|0.0988|0.1402|
|
82 |
+
| Mistral-7B-v0.1 |7B|**0.2555**|**0.2933**|
|
83 |
+
| japanese-stablelm-base-gamma-7b|7B|0.1823|0.1915|
|
84 |
+
| Swallow-MS-7b-v0.1 |7B|0.2305|0.2768|
|
85 |
|
86 |
## Usage
|
87 |
|