Edentns
/

DataVortexS-10.7B-dpo-v1.0

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JeongwonChoi commited on Jan 19, 2024

Commit

d42328a

·

verified ·

1 Parent(s): 3b2d681

Update README.md

Files changed (1) hide show

README.md +7 -9

README.md CHANGED Viewed

@@ -50,15 +50,13 @@ text = """\
 ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
-On Benchmarking ...
-| Task             |  0-shot |  5-shot | 10-shot | 50-shot |
-| :--------------- | ------: | ------: | ------: | ------: |
-| kobest_boolq     |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_copa      |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_hellaswag |     0.0 |     0.0 |     0.0 |     0.0 |
-| kobest_sentineg  |     0.0 |     0.0 |     0.0 |     0.0 |
-| **Average**      | **0.0** | **0.0** | **0.0** | **0.0** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**

 ### **[Ko LM Eval Harness](https://github.com/Beomi/ko-lm-evaluation-harness)**
+| Task             |         0-shot |       5-shot |        10-shot |        50-shot |
+| :--------------- | -------------: | -----------: | -------------: | -------------: |
+| kobest_boolq     |       0.867265 |     0.930834 |       0.938736 |       0.938023 |
+| kobest_copa      |       0.722438 |     0.792716 |       0.782842 |       0.805869 |
+| kobest_hellaswag |       0.484781 |     0.480055 |       0.496734 |       0.501488 |
+| kobest_sentineg  |       0.759887 |     0.964735 |       0.964735 |       0.972291 |
+| **Average**      | **0.70859275** | **0.792085** | **0.79576175** | **0.80441775** |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**