CocoRoF commited on
Commit
34b994f
·
verified ·
1 Parent(s): 8f92476

modu_bf2018_chunk_03 Done

Browse files
Files changed (1) hide show
  1. README.md +11 -12
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [x2bee/KoModernBERT-base-mlm-v02-ckp02](https://huggingface.co/x2bee/KoModernBERT-base-mlm-v02-ckp02) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.9006
20
 
21
  ## Model description
22
 
@@ -53,17 +53,16 @@ The following hyperparameters were used during training:
53
 
54
  | Training Loss | Epoch | Step | Validation Loss |
55
  |:-------------:|:------:|:-----:|:---------------:|
56
- | 17.1231 | 0.0867 | 3000 | 2.1503 |
57
- | 16.9213 | 0.1734 | 6000 | 2.1170 |
58
- | 16.6843 | 0.2601 | 9000 | 2.0872 |
59
- | 16.501 | 0.3468 | 12000 | 2.0641 |
60
- | 16.2914 | 0.4335 | 15000 | 2.0396 |
61
- | 16.1829 | 0.5201 | 18000 | 2.0157 |
62
- | 15.9756 | 0.6068 | 21000 | 1.9904 |
63
- | 15.7217 | 0.6935 | 24000 | 1.9681 |
64
- | 15.5407 | 0.7802 | 27000 | 1.9437 |
65
- | 15.389 | 0.8669 | 30000 | 1.9219 |
66
- | 15.1363 | 0.9536 | 33000 | 1.9006 |
67
 
68
 
69
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [x2bee/KoModernBERT-base-mlm-v02-ckp02](https://huggingface.co/x2bee/KoModernBERT-base-mlm-v02-ckp02) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.6437
20
 
21
  ## Model description
22
 
 
53
 
54
  | Training Loss | Epoch | Step | Validation Loss |
55
  |:-------------:|:------:|:-----:|:---------------:|
56
+ | 14.3633 | 0.0986 | 3000 | 1.7944 |
57
+ | 14.0205 | 0.1973 | 6000 | 1.7638 |
58
+ | 14.0391 | 0.2959 | 9000 | 1.7430 |
59
+ | 13.8014 | 0.3946 | 12000 | 1.7255 |
60
+ | 13.6803 | 0.4932 | 15000 | 1.7118 |
61
+ | 13.5763 | 0.5919 | 18000 | 1.6961 |
62
+ | 13.4827 | 0.6905 | 21000 | 1.6824 |
63
+ | 13.3855 | 0.7892 | 24000 | 1.6700 |
64
+ | 13.2238 | 0.8878 | 27000 | 1.6558 |
65
+ | 13.0954 | 0.9865 | 30000 | 1.6437 |
 
66
 
67
 
68
  ### Framework versions