modu_bf2018_chunk_03 Done
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
16 |
|
17 |
This model is a fine-tuned version of [x2bee/KoModernBERT-base-mlm-v02-ckp02](https://huggingface.co/x2bee/KoModernBERT-base-mlm-v02-ckp02) on the None dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
-
- Loss: 1.
|
20 |
|
21 |
## Model description
|
22 |
|
@@ -53,17 +53,16 @@ The following hyperparameters were used during training:
|
|
53 |
|
54 |
| Training Loss | Epoch | Step | Validation Loss |
|
55 |
|:-------------:|:------:|:-----:|:---------------:|
|
56 |
-
|
|
57 |
-
|
|
58 |
-
|
|
59 |
-
|
|
60 |
-
|
|
61 |
-
|
|
62 |
-
|
|
63 |
-
|
|
64 |
-
|
|
65 |
-
|
|
66 |
-
| 15.1363 | 0.9536 | 33000 | 1.9006 |
|
67 |
|
68 |
|
69 |
### Framework versions
|
|
|
16 |
|
17 |
This model is a fine-tuned version of [x2bee/KoModernBERT-base-mlm-v02-ckp02](https://huggingface.co/x2bee/KoModernBERT-base-mlm-v02-ckp02) on the None dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
+
- Loss: 1.6437
|
20 |
|
21 |
## Model description
|
22 |
|
|
|
53 |
|
54 |
| Training Loss | Epoch | Step | Validation Loss |
|
55 |
|:-------------:|:------:|:-----:|:---------------:|
|
56 |
+
| 14.3633 | 0.0986 | 3000 | 1.7944 |
|
57 |
+
| 14.0205 | 0.1973 | 6000 | 1.7638 |
|
58 |
+
| 14.0391 | 0.2959 | 9000 | 1.7430 |
|
59 |
+
| 13.8014 | 0.3946 | 12000 | 1.7255 |
|
60 |
+
| 13.6803 | 0.4932 | 15000 | 1.7118 |
|
61 |
+
| 13.5763 | 0.5919 | 18000 | 1.6961 |
|
62 |
+
| 13.4827 | 0.6905 | 21000 | 1.6824 |
|
63 |
+
| 13.3855 | 0.7892 | 24000 | 1.6700 |
|
64 |
+
| 13.2238 | 0.8878 | 27000 | 1.6558 |
|
65 |
+
| 13.0954 | 0.9865 | 30000 | 1.6437 |
|
|
|
66 |
|
67 |
|
68 |
### Framework versions
|