Update README.md
Browse files
README.md
CHANGED
|
@@ -15,4 +15,21 @@ pipeline_tag: text-generation
|
|
| 15 |
|
| 16 |
## This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.
|
| 17 |
|
| 18 |
-
## Model Developers Chihoon Lee(chihoonlee10), T3Q
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.
|
| 17 |
|
| 18 |
+
## Model Developers Chihoon Lee(chihoonlee10), T3Q
|
| 19 |
+
|
| 20 |
+
hf (pretrained=chihoonlee10/T3Q-ko-solar-dpo-v6.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
|
| 21 |
+
| Task |Version| Metric |Value | |Stderr|
|
| 22 |
+
|----------------|------:|--------|-----:|---|-----:|
|
| 23 |
+
|kobest_boolq | 0|acc |0.5028|± |0.0133|
|
| 24 |
+
| | |macro_f1|0.3396|± |0.0067|
|
| 25 |
+
|kobest_copa | 0|acc |0.8020|± |0.0126|
|
| 26 |
+
| | |macro_f1|0.8018|± |0.0126|
|
| 27 |
+
|kobest_hellaswag| 0|acc |0.5340|± |0.0223|
|
| 28 |
+
| | |acc_norm|0.5720|± |0.0221|
|
| 29 |
+
| | |macro_f1|0.5322|± |0.0224|
|
| 30 |
+
|kobest_sentineg | 0|acc |0.7985|± |0.0202|
|
| 31 |
+
| | |macro_f1|0.7956|± |0.0205|
|
| 32 |
+
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
|