Update README.md
Browse files
README.md
CHANGED
|
@@ -21,6 +21,18 @@ license_link: LICENSE
|
|
| 21 |
|
| 22 |
## Benchmark
|
| 23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
# Original Model Card by Beomi
|
| 26 |
|
|
|
|
| 21 |
|
| 22 |
## Benchmark
|
| 23 |
|
| 24 |
+
### Kobest
|
| 25 |
+
|
| 26 |
+
| Task | beomi/Llama-3-Open-Ko-8B-Instruct | maywell/Llama-3-Ko-8B-Instruct |
|
| 27 |
+
| --- | --- | --- |
|
| 28 |
+
| kobest overall | 0.6220 ± 0.0070 | 0.6852 ± 0.0066 |
|
| 29 |
+
| kobest_boolq| 0.6254 ± 0.0129| 0.7208 ± 0.0120
|
| 30 |
+
| kobest_copa| 0.7110 ± 0.0143| 0.7650 ± 0.0134
|
| 31 |
+
| kobest_hellaswag| 0.3840 ± 0.0218| 0.4440 ± 0.0222
|
| 32 |
+
| kobest_sentineg| 0.8388 ± 0.0185| 0.9194 ± 0.0137
|
| 33 |
+
| kobest_wic| 0.5738 ± 0.0139| 0.6040 ± 0.0138
|
| 34 |
+
|
| 35 |
+
|
| 36 |
|
| 37 |
# Original Model Card by Beomi
|
| 38 |
|