Hugging Face's logo

realHarter
/
results

Text2Text Generation
Transformers
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
realHarter commited on
Commit
44dc686
·
verified ·
1 Parent(s): 938382c

End of training

Browse files
Files changed (3) hide show
  1. README.md +15 -7
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [ml6team/mt5-small-german-finetune-mlsum](https://huggingface.co/ml6team/mt5-small-german-finetune-mlsum) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 2.6957
18
 
19
  ## Model description
20
 
@@ -34,21 +34,29 @@ More information needed
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 5e-05
37
- - train_batch_size: 1
38
- - eval_batch_size: 1
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
  - lr_scheduler_warmup_steps: 500
43
- - num_epochs: 3
 
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 4.4486 | 1.0 | 90 | 3.2270 |
50
- | 4.0121 | 2.0 | 180 | 2.9492 |
51
- | 4.4313 | 3.0 | 270 | 2.6957 |
 
 
 
 
 
 
 
52
 
53
 
54
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [ml6team/mt5-small-german-finetune-mlsum](https://huggingface.co/ml6team/mt5-small-german-finetune-mlsum) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: nan
18
 
19
  ## Model description
20
 
 
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 5e-05
37
+ - train_batch_size: 4
38
+ - eval_batch_size: 4
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
  - lr_scheduler_warmup_steps: 500
43
+ - num_epochs: 10
44
+ - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 4.0068 | 1.0 | 23 | 4.0449 |
51
+ | 3.2083 | 2.0 | 46 | 4.0446 |
52
+ | 2.9676 | 3.0 | 69 | 4.0434 |
53
+ | 4.0256 | 4.0 | 92 | 4.0409 |
54
+ | 3.9972 | 5.0 | 115 | 4.0401 |
55
+ | 3.12 | 6.0 | 138 | 4.0395 |
56
+ | 3.1067 | 7.0 | 161 | 4.0388 |
57
+ | 3.1965 | 8.0 | 184 | 4.0384 |
58
+ | 3.3512 | 9.0 | 207 | nan |
59
+ | 0.0 | 10.0 | 230 | nan |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d389c0f1eef36f605b37009526fe269c4b01ccff8f176c9db03f955593b93ece
3
  size 1200729512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57b563f463bf1613b3d2e90aec9b8cbbeabce8fa7c6c3aef8e4f1b44eed5f7de
3
  size 1200729512
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6be714bc2f0e812b47ac5fee98d6fa13ae37b4c7cedfe5cd0f1f42e4325a5edf
3
  size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0ecd6c2baadac24ca9bf7aa809bdfc43c43e9fd4c9b7b8b753606a76b5dc73a
3
  size 5048