CocoRoF commited on
Commit
f893c7d
·
verified ·
1 Parent(s): 83e69d3

modu_bf2018_chunk_03 Done

Browse files
Files changed (1) hide show
  1. README.md +15 -6
README.md CHANGED
@@ -14,9 +14,9 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # KoModernBERT-base-mlm-v02-ckp02
16
 
17
- This model is a fine-tuned version of [x2bee/KoModernBERT-base-mlm-v02-ckp02](https://huggingface.co/x2bee/KoModernBERT-base-mlm-v02-ckp02) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2.0023
20
 
21
  ## Model description
22
 
@@ -51,10 +51,19 @@ The following hyperparameters were used during training:
51
 
52
  ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss |
55
- |:-------------:|:------:|:----:|:---------------:|
56
- | 16.4669 | 0.3468 | 3000 | 2.0511 |
57
- | 15.9854 | 0.6935 | 6000 | 2.0023 |
 
 
 
 
 
 
 
 
 
58
 
59
 
60
  ### Framework versions
 
14
 
15
  # KoModernBERT-base-mlm-v02-ckp02
16
 
17
+ This model is a fine-tuned version of [x2bee/KoModernBERT-base-mlm-v02-ckp02](https://huggingface.co/x2bee/KoModernBERT-base-mlm-v02-ckp02) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.9006
20
 
21
  ## Model description
22
 
 
51
 
52
  ### Training results
53
 
54
+ | Training Loss | Epoch | Step | Validation Loss |
55
+ |:-------------:|:------:|:-----:|:---------------:|
56
+ | 17.1231 | 0.0867 | 3000 | 2.1503 |
57
+ | 16.9213 | 0.1734 | 6000 | 2.1170 |
58
+ | 16.6843 | 0.2601 | 9000 | 2.0872 |
59
+ | 16.501 | 0.3468 | 12000 | 2.0641 |
60
+ | 16.2914 | 0.4335 | 15000 | 2.0396 |
61
+ | 16.1829 | 0.5201 | 18000 | 2.0157 |
62
+ | 15.9756 | 0.6068 | 21000 | 1.9904 |
63
+ | 15.7217 | 0.6935 | 24000 | 1.9681 |
64
+ | 15.5407 | 0.7802 | 27000 | 1.9437 |
65
+ | 15.389 | 0.8669 | 30000 | 1.9219 |
66
+ | 15.1363 | 0.9536 | 33000 | 1.9006 |
67
 
68
 
69
  ### Framework versions