Clyvey
/

squad_qna_model

Multiple Choice

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Community

Clyvey commited on Oct 22, 2023

Commit

9c17412

·

1 Parent(s): e726b5b

Model save

Files changed (1) hide show

README.md +6 -5

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the squad dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2039
 ## Model description
@@ -42,15 +42,16 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 3
 ### Training results
 | Training Loss | Epoch | Step  | Validation Loss |
 |:-------------:|:-----:|:-----:|:---------------:|
-| 0.2317        | 1.0   | 21900 | 0.1589          |
-| 0.1097        | 2.0   | 43800 | 0.2011          |
-| 0.038         | 3.0   | 65700 | 0.2039          |
 ### Framework versions

 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the squad dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.1156
 ## Model description
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
+- num_epochs: 1
 ### Training results
 | Training Loss | Epoch | Step  | Validation Loss |
 |:-------------:|:-----:|:-----:|:---------------:|
+| 0.2903        | 0.23  | 5000  | 0.1721          |
+| 0.1883        | 0.46  | 10000 | 0.1771          |
+| 0.143         | 0.68  | 15000 | 0.1278          |
+| 0.1952        | 0.91  | 20000 | 0.1156          |
 ### Framework versions