x2bee
/

KoModernBERT-base-mlm-v01-ckp01

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Community

CocoRoF commited on 14 days ago

Commit

76be005

·

verified ·

1 Parent(s): 6f86606

End of training

Files changed (1) hide show

README.md +14 -14

README.md CHANGED Viewed

@@ -1,22 +1,22 @@
 ---
 library_name: transformers
 license: apache-2.0
-base_model: x2bee/KoModernBERT-base-ckp07
 tags:
 - generated_from_trainer
 model-index:
-- name: KoModernBERT-base-mlm-v01
   results: []
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
-# KoModernBERT-base-mlm-v01
-This model is a fine-tuned version of [x2bee/KoModernBERT-base-ckp07](https://huggingface.co/x2bee/KoModernBERT-base-ckp07) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.6780
 ## Model description
@@ -53,15 +53,15 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 15.134        | 0.1109 | 1000 | 1.9037          |
-| 14.8201       | 0.2218 | 2000 | 1.8606          |
-| 14.5959       | 0.3328 | 3000 | 1.8259          |
-| 14.3035       | 0.4437 | 4000 | 1.8030          |
-| 14.1103       | 0.5546 | 5000 | 1.7775          |
-| 13.9572       | 0.6655 | 6000 | 1.7474          |
-| 13.7771       | 0.7764 | 7000 | 1.7183          |
-| 13.6306       | 0.8873 | 8000 | 1.7050          |
-| 13.4867       | 0.9983 | 9000 | 1.6780          |
 ### Framework versions

 ---
 library_name: transformers
 license: apache-2.0
+base_model: x2bee/KoModernBERT-base-mlm-v01
 tags:
 - generated_from_trainer
 model-index:
+- name: KoModernBERT-base-mlm-v01-ckp01
   results: []
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
+# KoModernBERT-base-mlm-v01-ckp01
+This model is a fine-tuned version of [x2bee/KoModernBERT-base-mlm-v01](https://huggingface.co/x2bee/KoModernBERT-base-mlm-v01) on an unknown dataset.
 It achieves the following results on the evaluation set:
+- Loss: 2.7654
 ## Model description
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
+| 25.1808       | 0.1051 | 1000 | 3.1264          |
+| 24.5518       | 0.2102 | 2000 | 3.0455          |
+| 23.9605       | 0.3153 | 3000 | nan             |
+| 23.8549       | 0.4204 | 4000 | 2.9420          |
+| 23.2944       | 0.5255 | 5000 | 2.9115          |
+| 23.0988       | 0.6306 | 6000 | 2.8620          |
+| 22.7786       | 0.7357 | 7000 | 2.8250          |
+| 22.4325       | 0.8408 | 8000 | 2.7785          |
+| 21.9527       | 0.9459 | 9000 | 2.7654          |
 ### Framework versions