gokulsrinivasagan commited on
Commit
c4ddc2f
·
verified ·
1 Parent(s): 330e368

Model save

Browse files
README.md ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ base_model: gokulsrinivasagan/bert_tiny_lda_100_v1_book
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - spearmanr
8
+ model-index:
9
+ - name: bert_tiny_lda_100_v1_book_stsb
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # bert_tiny_lda_100_v1_book_stsb
17
+
18
+ This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_100_v1_book](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_100_v1_book) on an unknown dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.8117
21
+ - Pearson: 0.8090
22
+ - Spearmanr: 0.8066
23
+ - Combined Score: 0.8078
24
+
25
+ ## Model description
26
+
27
+ More information needed
28
+
29
+ ## Intended uses & limitations
30
+
31
+ More information needed
32
+
33
+ ## Training and evaluation data
34
+
35
+ More information needed
36
+
37
+ ## Training procedure
38
+
39
+ ### Training hyperparameters
40
+
41
+ The following hyperparameters were used during training:
42
+ - learning_rate: 5e-05
43
+ - train_batch_size: 256
44
+ - eval_batch_size: 256
45
+ - seed: 10
46
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
+ - lr_scheduler_type: linear
48
+ - num_epochs: 50
49
+
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss | Pearson | Spearmanr | Combined Score |
53
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:---------:|:--------------:|
54
+ | 3.1938 | 1.0 | 23 | 2.4088 | 0.1233 | 0.1363 | 0.1298 |
55
+ | 1.724 | 2.0 | 46 | 1.3509 | 0.6695 | 0.6702 | 0.6698 |
56
+ | 1.1162 | 3.0 | 69 | 0.9383 | 0.7654 | 0.7625 | 0.7639 |
57
+ | 0.8449 | 4.0 | 92 | 0.8558 | 0.7876 | 0.7849 | 0.7863 |
58
+ | 0.7011 | 5.0 | 115 | 0.9826 | 0.7761 | 0.7835 | 0.7798 |
59
+ | 0.6154 | 6.0 | 138 | 0.8605 | 0.7884 | 0.7859 | 0.7871 |
60
+ | 0.5011 | 7.0 | 161 | 0.7928 | 0.8049 | 0.8016 | 0.8033 |
61
+ | 0.4464 | 8.0 | 184 | 0.8498 | 0.8009 | 0.7998 | 0.8003 |
62
+ | 0.3985 | 9.0 | 207 | 0.8156 | 0.7999 | 0.7968 | 0.7984 |
63
+ | 0.3519 | 10.0 | 230 | 0.8549 | 0.8050 | 0.8028 | 0.8039 |
64
+ | 0.366 | 11.0 | 253 | 0.8143 | 0.8063 | 0.8037 | 0.8050 |
65
+ | 0.3156 | 12.0 | 276 | 0.8117 | 0.8090 | 0.8066 | 0.8078 |
66
+
67
+
68
+ ### Framework versions
69
+
70
+ - Transformers 4.46.3
71
+ - Pytorch 2.2.1+cu118
72
+ - Datasets 2.17.0
73
+ - Tokenizers 0.20.3
logs/events.out.tfevents.1733843245.ki-g0008.684565.30 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:137318af462b78d8ca883ed5d8cada6b396a0e73c2ae61056b008d92b3ee44b8
3
- size 11508
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9a22277acaa99677f6b4c2a5e35169c8b8227cfb8eb3a02d4706bf15e41fb70
3
+ size 13150
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e7d35e2ebafc0c1f1d38ee596510e58694b329d16cceb97a4b0d41ab7dad144c
3
  size 131854692
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9015cb8c4650e1d5ae12a965e2a773bfb1a75d9dafafaa1446b40971e6459e68
3
  size 131854692