File size: 27,813 Bytes
a852de2
 
0f6d4bc
a852de2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2562b31
a852de2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
---
library_name: transformers
license: apache-2.0
base_model: google/vit-base-patch16-224-in21k
tags:
- image-classification
- generated_from_trainer
datasets:
- imagefolder
metrics:
- accuracy
model-index:
- name: vit-base
  results:
  - task:
      name: Image Classification
      type: image-classification
    dataset:
      name: Ahmed-ibn-Harun/BrainHermorrhage
      type: imagefolder
      config: default
      split: validation
      args: default
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.8261405672009864
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# BrainHermorrhage-vit-base

This model is a fine-tuned version of [google/vit-base-patch16-224-in21k](https://huggingface.co/google/vit-base-patch16-224-in21k) on the Ahmed-ibn-Harun/BrainHermorrhage dataset.
It achieves the following results on the evaluation set:
- Loss: 0.3755
- Accuracy: 0.8261
- Sensitivity: 0.7221
- Specificity: 0.9289
- F1 Score: 0.8050
- Auc: 0.9162

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0003
- train_batch_size: 16
- eval_batch_size: 8
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 50
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch   | Step  | Validation Loss | Accuracy | Sensitivity | Specificity | F1 Score | Auc    |
|:-------------:|:-------:|:-----:|:---------------:|:--------:|:-----------:|:-----------:|:--------:|:------:|
| 0.3331        | 0.2188  | 100   | 0.4220          | 0.7891   | 0.6868      | 0.8902      | 0.7641   | 0.8947 |
| 0.4904        | 0.4376  | 200   | 0.4409          | 0.8038   | 0.7750      | 0.8324      | 0.7971   | 0.8931 |
| 0.4875        | 0.6565  | 300   | 0.5088          | 0.8162   | 0.9009      | 0.7324      | 0.8298   | 0.9057 |
| 0.4366        | 0.8753  | 400   | 0.3726          | 0.8314   | 0.7671      | 0.8951      | 0.8190   | 0.9190 |
| 0.4663        | 1.0941  | 500   | 0.4225          | 0.8157   | 0.8910      | 0.7412      | 0.8278   | 0.9201 |
| 0.2961        | 1.3129  | 600   | 0.3632          | 0.8339   | 0.7929      | 0.8745      | 0.8260   | 0.9244 |
| 0.3367        | 1.5317  | 700   | 0.4454          | 0.8117   | 0.8870      | 0.7373      | 0.8241   | 0.9083 |
| 0.4084        | 1.7505  | 800   | 0.5469          | 0.7408   | 0.9732      | 0.5108      | 0.7888   | 0.9068 |
| 0.3161        | 1.9694  | 900   | 0.3893          | 0.8329   | 0.8672      | 0.7990      | 0.8377   | 0.9282 |
| 0.4762        | 2.1882  | 1000  | 0.4871          | 0.7363   | 0.9633      | 0.5118      | 0.7842   | 0.8974 |
| 0.4006        | 2.4070  | 1100  | 0.4228          | 0.7900   | 0.9326      | 0.6490      | 0.8154   | 0.9257 |
| 0.4541        | 2.6258  | 1200  | 0.3389          | 0.8487   | 0.7641      | 0.9324      | 0.8340   | 0.9349 |
| 0.5397        | 2.8446  | 1300  | 0.4587          | 0.7565   | 0.9732      | 0.5422      | 0.7990   | 0.9244 |
| 0.2115        | 3.0635  | 1400  | 0.3976          | 0.8344   | 0.8196      | 0.8490      | 0.8312   | 0.9223 |
| 0.3588        | 3.2823  | 1500  | 0.3928          | 0.8211   | 0.8949      | 0.7480      | 0.8326   | 0.9208 |
| 0.3377        | 3.5011  | 1600  | 0.3943          | 0.8157   | 0.7483      | 0.8824      | 0.8015   | 0.9128 |
| 0.3385        | 3.7199  | 1700  | 0.3627          | 0.8428   | 0.8256      | 0.8598      | 0.8393   | 0.9247 |
| 0.3793        | 3.9387  | 1800  | 0.4015          | 0.8063   | 0.7592      | 0.8529      | 0.7958   | 0.9007 |
| 0.2774        | 4.1575  | 1900  | 0.4174          | 0.8186   | 0.8018      | 0.8353      | 0.8147   | 0.9090 |
| 0.2964        | 4.3764  | 2000  | 0.4120          | 0.8245   | 0.8940      | 0.7559      | 0.8352   | 0.9243 |
| 0.2042        | 4.5952  | 2100  | 0.3984          | 0.8383   | 0.8414      | 0.8353      | 0.8381   | 0.9214 |
| 0.2336        | 4.8140  | 2200  | 0.4263          | 0.8241   | 0.8722      | 0.7765      | 0.8314   | 0.9242 |
| 0.2292        | 5.0328  | 2300  | 0.4430          | 0.8339   | 0.8186      | 0.8490      | 0.8306   | 0.9241 |
| 0.265         | 5.2516  | 2400  | 0.4647          | 0.8314   | 0.7681      | 0.8941      | 0.8192   | 0.9204 |
| 0.2754        | 5.4705  | 2500  | 0.5476          | 0.7886   | 0.9128      | 0.6657      | 0.8111   | 0.9116 |
| 0.1859        | 5.6893  | 2600  | 0.4330          | 0.8324   | 0.8414      | 0.8235      | 0.8332   | 0.9218 |
| 0.1785        | 5.9081  | 2700  | 0.4180          | 0.8369   | 0.8375      | 0.8363      | 0.8362   | 0.9199 |
| 0.2057        | 6.1269  | 2800  | 0.4660          | 0.8319   | 0.8543      | 0.8098      | 0.8349   | 0.9158 |
| 0.289         | 6.3457  | 2900  | 0.4399          | 0.8186   | 0.8196      | 0.8176      | 0.8180   | 0.9086 |
| 0.1172        | 6.5646  | 3000  | 0.5597          | 0.8260   | 0.8474      | 0.8049      | 0.8289   | 0.9085 |
| 0.1758        | 6.7834  | 3100  | 0.4902          | 0.8201   | 0.8335      | 0.8069      | 0.8217   | 0.9078 |
| 0.2185        | 7.0022  | 3200  | 0.4738          | 0.8211   | 0.8295      | 0.8127      | 0.8218   | 0.9108 |
| 0.2255        | 7.2210  | 3300  | 0.5072          | 0.8098   | 0.8771      | 0.7431      | 0.8210   | 0.9082 |
| 0.213         | 7.4398  | 3400  | 0.4879          | 0.8379   | 0.7919      | 0.8833      | 0.8293   | 0.9126 |
| 0.1528        | 7.6586  | 3500  | 0.6054          | 0.8137   | 0.8276      | 0.8         | 0.8154   | 0.9057 |
| 0.1834        | 7.8775  | 3600  | 0.5653          | 0.8260   | 0.7532      | 0.8980      | 0.8115   | 0.9141 |
| 0.0812        | 8.0963  | 3700  | 0.6640          | 0.8176   | 0.7284      | 0.9059      | 0.7989   | 0.9068 |
| 0.1422        | 8.3151  | 3800  | 0.5916          | 0.8255   | 0.7721      | 0.8784      | 0.8149   | 0.9075 |
| 0.1116        | 8.5339  | 3900  | 0.5746          | 0.8226   | 0.8583      | 0.7873      | 0.8279   | 0.9057 |
| 0.1811        | 8.7527  | 4000  | 0.4679          | 0.8359   | 0.7869      | 0.8843      | 0.8267   | 0.9245 |
| 0.1949        | 8.9716  | 4100  | 0.4645          | 0.8201   | 0.7641      | 0.8755      | 0.8086   | 0.9048 |
| 0.036         | 9.1904  | 4200  | 0.6486          | 0.8349   | 0.7889      | 0.8804      | 0.8262   | 0.9116 |
| 0.1117        | 9.4092  | 4300  | 0.5656          | 0.8236   | 0.7433      | 0.9029      | 0.8073   | 0.9125 |
| 0.1101        | 9.6280  | 4400  | 0.5197          | 0.8285   | 0.8731      | 0.7843      | 0.8351   | 0.9226 |
| 0.2064        | 9.8468  | 4500  | 0.6169          | 0.8270   | 0.7641      | 0.8892      | 0.8146   | 0.9132 |
| 0.0647        | 10.0656 | 4600  | 0.5593          | 0.8255   | 0.7542      | 0.8961      | 0.8113   | 0.9122 |
| 0.0566        | 10.2845 | 4700  | 0.5822          | 0.8245   | 0.7384      | 0.9098      | 0.8072   | 0.9182 |
| 0.1324        | 10.5033 | 4800  | 0.5593          | 0.8319   | 0.7948      | 0.8686      | 0.8247   | 0.9146 |
| 0.0824        | 10.7221 | 4900  | 0.6553          | 0.8117   | 0.7037      | 0.9186      | 0.7880   | 0.9130 |
| 0.2134        | 10.9409 | 5000  | 0.5847          | 0.8334   | 0.8880      | 0.7794      | 0.8413   | 0.9271 |
| 0.0835        | 11.1597 | 5100  | 0.6585          | 0.8314   | 0.8008      | 0.8618      | 0.8253   | 0.9130 |
| 0.0936        | 11.3786 | 5200  | 0.8768          | 0.8191   | 0.7939      | 0.8441      | 0.8136   | 0.9062 |
| 0.0325        | 11.5974 | 5300  | 0.6502          | 0.8423   | 0.8315      | 0.8529      | 0.8398   | 0.9209 |
| 0.1054        | 11.8162 | 5400  | 0.5742          | 0.8354   | 0.8256      | 0.8451      | 0.833    | 0.9186 |
| 0.0157        | 12.0350 | 5500  | 0.7790          | 0.8324   | 0.8256      | 0.8392      | 0.8305   | 0.9150 |
| 0.0929        | 12.2538 | 5600  | 0.5779          | 0.8433   | 0.7978      | 0.8882      | 0.8351   | 0.9183 |
| 0.0553        | 12.4726 | 5700  | 0.6642          | 0.8369   | 0.8157      | 0.8578      | 0.8326   | 0.9154 |
| 0.1012        | 12.6915 | 5800  | 0.6882          | 0.8344   | 0.8494      | 0.8196      | 0.8361   | 0.9218 |
| 0.1292        | 12.9103 | 5900  | 0.6949          | 0.8310   | 0.7800      | 0.8814      | 0.8211   | 0.9114 |
| 0.103         | 13.1291 | 6000  | 0.7031          | 0.8398   | 0.8216      | 0.8578      | 0.8361   | 0.9162 |
| 0.0652        | 13.3479 | 6100  | 0.7927          | 0.8379   | 0.8176      | 0.8578      | 0.8338   | 0.9178 |
| 0.1194        | 13.5667 | 6200  | 0.7817          | 0.8211   | 0.7602      | 0.8814      | 0.8086   | 0.9125 |
| 0.2684        | 13.7856 | 6300  | 0.7446          | 0.8221   | 0.7017      | 0.9412      | 0.7968   | 0.9164 |
| 0.1194        | 14.0044 | 6400  | 0.7420          | 0.8334   | 0.8305      | 0.8363      | 0.8322   | 0.9152 |
| 0.0548        | 14.2232 | 6500  | 0.8545          | 0.8295   | 0.8543      | 0.8049      | 0.8329   | 0.8918 |
| 0.0681        | 14.4420 | 6600  | 0.8680          | 0.7915   | 0.6373      | 0.9441      | 0.7525   | 0.9094 |
| 0.0627        | 14.6608 | 6700  | 0.6181          | 0.8487   | 0.8028      | 0.8941      | 0.8407   | 0.9206 |
| 0.0565        | 14.8796 | 6800  | 0.7248          | 0.8241   | 0.8117      | 0.8363      | 0.8211   | 0.9108 |
| 0.0879        | 15.0985 | 6900  | 0.6817          | 0.8295   | 0.8484      | 0.8108      | 0.8319   | 0.9208 |
| 0.1235        | 15.3173 | 7000  | 0.7360          | 0.8344   | 0.8434      | 0.8255      | 0.8351   | 0.9143 |
| 0.1256        | 15.5361 | 7100  | 0.6166          | 0.8300   | 0.7839      | 0.8755      | 0.8210   | 0.9114 |
| 0.0353        | 15.7549 | 7200  | 0.7718          | 0.8339   | 0.8771      | 0.7912      | 0.8401   | 0.9231 |
| 0.0838        | 15.9737 | 7300  | 0.7930          | 0.8305   | 0.7919      | 0.8686      | 0.8229   | 0.8963 |
| 0.0345        | 16.1926 | 7400  | 0.9201          | 0.8231   | 0.7304      | 0.9147      | 0.8041   | 0.8816 |
| 0.0263        | 16.4114 | 7500  | 0.8642          | 0.8310   | 0.7433      | 0.9176      | 0.8139   | 0.9021 |
| 0.0471        | 16.6302 | 7600  | 0.8542          | 0.8324   | 0.7631      | 0.9010      | 0.8191   | 0.9031 |
| 0.0894        | 16.8490 | 7700  | 0.7756          | 0.8034   | 0.7116      | 0.8941      | 0.7826   | 0.8999 |
| 0.0649        | 17.0678 | 7800  | 0.7112          | 0.8344   | 0.8484      | 0.8206      | 0.8359   | 0.9077 |
| 0.0567        | 17.2867 | 7900  | 0.7433          | 0.8452   | 0.8394      | 0.8510      | 0.8436   | 0.9106 |
| 0.0229        | 17.5055 | 8000  | 0.8775          | 0.8255   | 0.7542      | 0.8961      | 0.8113   | 0.9017 |
| 0.009         | 17.7243 | 8100  | 0.8561          | 0.8349   | 0.7958      | 0.8735      | 0.8274   | 0.9062 |
| 0.0838        | 17.9431 | 8200  | 0.9441          | 0.8255   | 0.8771      | 0.7745      | 0.8333   | 0.9211 |
| 0.0958        | 18.1619 | 8300  | 0.9286          | 0.8255   | 0.7374      | 0.9127      | 0.8078   | 0.8961 |
| 0.0422        | 18.3807 | 8400  | 0.8053          | 0.8369   | 0.8186      | 0.8549      | 0.8331   | 0.9114 |
| 0.053         | 18.5996 | 8500  | 0.8440          | 0.8388   | 0.8067      | 0.8706      | 0.8327   | 0.8972 |
| 0.0462        | 18.8184 | 8600  | 0.7419          | 0.8221   | 0.8137      | 0.8304      | 0.8198   | 0.9108 |
| 0.0474        | 19.0372 | 8700  | 0.8702          | 0.8231   | 0.7849      | 0.8608      | 0.8152   | 0.8997 |
| 0.0257        | 19.2560 | 8800  | 0.8966          | 0.8157   | 0.7473      | 0.8833      | 0.8013   | 0.9049 |
| 0.0214        | 19.4748 | 8900  | 0.9787          | 0.8275   | 0.7839      | 0.8706      | 0.8188   | 0.8877 |
| 0.1409        | 19.6937 | 9000  | 0.8695          | 0.8379   | 0.7899      | 0.8853      | 0.8289   | 0.9084 |
| 0.0715        | 19.9125 | 9100  | 0.9500          | 0.8245   | 0.8028      | 0.8461      | 0.8198   | 0.8975 |
| 0.0331        | 20.1313 | 9200  | 0.9371          | 0.8334   | 0.8375      | 0.8294      | 0.8333   | 0.9042 |
| 0.0259        | 20.3501 | 9300  | 0.8587          | 0.8374   | 0.8127      | 0.8618      | 0.8325   | 0.9124 |
| 0.0093        | 20.5689 | 9400  | 0.7861          | 0.8393   | 0.8196      | 0.8588      | 0.8354   | 0.9182 |
| 0.0103        | 20.7877 | 9500  | 0.7921          | 0.8359   | 0.7800      | 0.8912      | 0.8254   | 0.9119 |
| 0.1187        | 21.0066 | 9600  | 0.7618          | 0.8260   | 0.7512      | 0.9         | 0.8111   | 0.9166 |
| 0.0024        | 21.2254 | 9700  | 0.9334          | 0.8319   | 0.8632      | 0.8010      | 0.8363   | 0.9123 |
| 0.0993        | 21.4442 | 9800  | 0.8067          | 0.8310   | 0.8682      | 0.7941      | 0.8363   | 0.9177 |
| 0.145         | 21.6630 | 9900  | 0.7816          | 0.8324   | 0.7770      | 0.8873      | 0.8218   | 0.9108 |
| 0.054         | 21.8818 | 10000 | 0.8371          | 0.8413   | 0.8523      | 0.8304      | 0.8423   | 0.9190 |
| 0.0446        | 22.1007 | 10100 | 0.8001          | 0.8354   | 0.7899      | 0.8804      | 0.8268   | 0.9084 |
| 0.1218        | 22.3195 | 10200 | 0.8164          | 0.8364   | 0.7701      | 0.9020      | 0.8240   | 0.9078 |
| 0.032         | 22.5383 | 10300 | 0.8353          | 0.8359   | 0.8256      | 0.8461      | 0.8334   | 0.9157 |
| 0.0804        | 22.7571 | 10400 | 0.8301          | 0.8314   | 0.7859      | 0.8765      | 0.8226   | 0.9149 |
| 0.0982        | 22.9759 | 10500 | 0.8366          | 0.8339   | 0.8305      | 0.8373      | 0.8326   | 0.9160 |
| 0.0153        | 23.1947 | 10600 | 0.8395          | 0.8295   | 0.7948      | 0.8637      | 0.8226   | 0.9150 |
| 0.0647        | 23.4136 | 10700 | 0.8342          | 0.8364   | 0.8662      | 0.8069      | 0.8404   | 0.9230 |
| 0.0906        | 23.6324 | 10800 | 0.8414          | 0.8078   | 0.8900      | 0.7265      | 0.8216   | 0.9166 |
| 0.0071        | 23.8512 | 10900 | 0.8552          | 0.8354   | 0.7889      | 0.8814      | 0.8266   | 0.9053 |
| 0.0254        | 24.0700 | 11000 | 0.8612          | 0.8428   | 0.7830      | 0.9020      | 0.8320   | 0.9009 |
| 0.0265        | 24.2888 | 11100 | 1.0379          | 0.8245   | 0.7195      | 0.9284      | 0.8031   | 0.8937 |
| 0.048         | 24.5077 | 11200 | 1.0143          | 0.8285   | 0.7611      | 0.8951      | 0.8153   | 0.8942 |
| 0.0005        | 24.7265 | 11300 | 0.9883          | 0.8310   | 0.8077      | 0.8539      | 0.8262   | 0.9024 |
| 0.1702        | 24.9453 | 11400 | 1.0282          | 0.8339   | 0.7512      | 0.9157      | 0.8181   | 0.9078 |
| 0.0006        | 25.1641 | 11500 | 0.9612          | 0.8448   | 0.8712      | 0.8186      | 0.8480   | 0.9151 |
| 0.0425        | 25.3829 | 11600 | 1.0040          | 0.8438   | 0.8612      | 0.8265      | 0.8457   | 0.9143 |
| 0.0006        | 25.6018 | 11700 | 0.9840          | 0.8305   | 0.7790      | 0.8814      | 0.8205   | 0.9117 |
| 0.0029        | 25.8206 | 11800 | 1.0850          | 0.8295   | 0.7294      | 0.9284      | 0.8097   | 0.9039 |
| 0.0776        | 26.0394 | 11900 | 0.9524          | 0.8334   | 0.8335      | 0.8333      | 0.8327   | 0.9119 |
| 0.0543        | 26.2582 | 12000 | 0.9541          | 0.8329   | 0.7572      | 0.9078      | 0.8184   | 0.9097 |
| 0.0018        | 26.4770 | 12100 | 0.8137          | 0.8393   | 0.8712      | 0.8078      | 0.8436   | 0.9225 |
| 0.0512        | 26.6958 | 12200 | 1.0741          | 0.8176   | 0.8712      | 0.7647      | 0.8261   | 0.8886 |
| 0.0008        | 26.9147 | 12300 | 1.0294          | 0.8393   | 0.8484      | 0.8304      | 0.8400   | 0.8987 |
| 0.043         | 27.1335 | 12400 | 0.9720          | 0.8334   | 0.8682      | 0.7990      | 0.8383   | 0.9135 |
| 0.0013        | 27.3523 | 12500 | 0.9571          | 0.8374   | 0.7800      | 0.8941      | 0.8267   | 0.9120 |
| 0.0163        | 27.5711 | 12600 | 0.9475          | 0.8305   | 0.8167      | 0.8441      | 0.8273   | 0.9102 |
| 0.0034        | 27.7899 | 12700 | 0.8116          | 0.8403   | 0.8365      | 0.8441      | 0.8390   | 0.9183 |
| 0.0014        | 28.0088 | 12800 | 0.9375          | 0.8305   | 0.8285      | 0.8324      | 0.8294   | 0.9139 |
| 0.0008        | 28.2276 | 12900 | 1.0335          | 0.8314   | 0.7602      | 0.9020      | 0.8177   | 0.9072 |
| 0.0497        | 28.4464 | 13000 | 1.0562          | 0.8285   | 0.7592      | 0.8971      | 0.8149   | 0.9039 |
| 0.0319        | 28.6652 | 13100 | 0.7997          | 0.8364   | 0.8444      | 0.8284      | 0.8369   | 0.9167 |
| 0.0932        | 28.8840 | 13200 | 0.8591          | 0.8167   | 0.8474      | 0.7863      | 0.8213   | 0.9142 |
| 0.0007        | 29.1028 | 13300 | 0.8555          | 0.8379   | 0.8246      | 0.8510      | 0.8349   | 0.9196 |
| 0.0025        | 29.3217 | 13400 | 0.9062          | 0.8359   | 0.8236      | 0.8480      | 0.8331   | 0.9147 |
| 0.0117        | 29.5405 | 13500 | 0.8089          | 0.8339   | 0.8345      | 0.8333      | 0.8333   | 0.9181 |
| 0.0505        | 29.7593 | 13600 | 0.9048          | 0.8329   | 0.8404      | 0.8255      | 0.8334   | 0.9167 |
| 0.0484        | 29.9781 | 13700 | 1.0264          | 0.8265   | 0.8573      | 0.7961      | 0.8309   | 0.9133 |
| 0.0004        | 30.1969 | 13800 | 1.0712          | 0.8349   | 0.8087      | 0.8608      | 0.8297   | 0.9053 |
| 0.0157        | 30.4158 | 13900 | 1.0159          | 0.8236   | 0.8186      | 0.8284      | 0.8219   | 0.9062 |
| 0.0004        | 30.6346 | 14000 | 1.0367          | 0.8305   | 0.8196      | 0.8412      | 0.8278   | 0.9022 |
| 0.0003        | 30.8534 | 14100 | 0.9853          | 0.8314   | 0.8345      | 0.8284      | 0.8312   | 0.9123 |
| 0.0039        | 31.0722 | 14200 | 0.9839          | 0.8413   | 0.7869      | 0.8951      | 0.8314   | 0.9124 |
| 0.0505        | 31.2910 | 14300 | 1.0911          | 0.8339   | 0.8741      | 0.7941      | 0.8396   | 0.9033 |
| 0.0007        | 31.5098 | 14400 | 0.8740          | 0.8374   | 0.8246      | 0.85        | 0.8345   | 0.9208 |
| 0.0004        | 31.7287 | 14500 | 0.9801          | 0.8398   | 0.8295      | 0.85        | 0.8374   | 0.9208 |
| 0.0592        | 31.9475 | 14600 | 1.0447          | 0.8305   | 0.8404      | 0.8206      | 0.8314   | 0.9165 |
| 0.0003        | 32.1663 | 14700 | 1.1005          | 0.8245   | 0.8543      | 0.7951      | 0.8288   | 0.9129 |
| 0.0002        | 32.3851 | 14800 | 1.1025          | 0.8319   | 0.8176      | 0.8461      | 0.8287   | 0.9108 |
| 0.0428        | 32.6039 | 14900 | 1.0779          | 0.8310   | 0.8236      | 0.8382      | 0.8289   | 0.9096 |
| 0.049         | 32.8228 | 15000 | 0.9729          | 0.8408   | 0.8295      | 0.8520      | 0.8383   | 0.9208 |
| 0.0219        | 33.0416 | 15100 | 0.9851          | 0.8211   | 0.7661      | 0.8755      | 0.8098   | 0.9120 |
| 0.001         | 33.2604 | 15200 | 0.9834          | 0.8349   | 0.8256      | 0.8441      | 0.8326   | 0.9166 |
| 0.0009        | 33.4792 | 15300 | 1.0128          | 0.8270   | 0.7463      | 0.9069      | 0.8110   | 0.9130 |
| 0.0146        | 33.6980 | 15400 | 0.9835          | 0.8300   | 0.7790      | 0.8804      | 0.8200   | 0.9097 |
| 0.0184        | 33.9168 | 15500 | 0.8922          | 0.8290   | 0.8276      | 0.8304      | 0.8280   | 0.9183 |
| 0.0528        | 34.1357 | 15600 | 0.9727          | 0.8398   | 0.7899      | 0.8892      | 0.8306   | 0.9107 |
| 0.0018        | 34.3545 | 15700 | 1.0313          | 0.8413   | 0.8196      | 0.8627      | 0.8370   | 0.9065 |
| 0.0002        | 34.5733 | 15800 | 1.0882          | 0.8374   | 0.7978      | 0.8765      | 0.8299   | 0.9065 |
| 0.0002        | 34.7921 | 15900 | 1.0866          | 0.8379   | 0.8236      | 0.8520      | 0.8348   | 0.9045 |
| 0.0865        | 35.0109 | 16000 | 1.0595          | 0.8300   | 0.7602      | 0.8990      | 0.8164   | 0.8971 |
| 0.0004        | 35.2298 | 16100 | 1.0287          | 0.8344   | 0.7988      | 0.8696      | 0.8275   | 0.9041 |
| 0.0003        | 35.4486 | 16200 | 1.0652          | 0.8305   | 0.8176      | 0.8431      | 0.8275   | 0.8877 |
| 0.0006        | 35.6674 | 16300 | 1.0627          | 0.8270   | 0.7988      | 0.8549      | 0.8212   | 0.8848 |
| 0.0003        | 35.8862 | 16400 | 1.1173          | 0.8339   | 0.7780      | 0.8892      | 0.8233   | 0.8843 |
| 0.0002        | 36.1050 | 16500 | 1.1114          | 0.8379   | 0.8048      | 0.8706      | 0.8315   | 0.8948 |
| 0.0002        | 36.3239 | 16600 | 1.1165          | 0.8379   | 0.8137      | 0.8618      | 0.8331   | 0.8968 |
| 0.0004        | 36.5427 | 16700 | 1.1693          | 0.8369   | 0.8147      | 0.8588      | 0.8324   | 0.8918 |
| 0.0002        | 36.7615 | 16800 | 1.1609          | 0.8364   | 0.8325      | 0.8402      | 0.8350   | 0.8856 |
| 0.0007        | 36.9803 | 16900 | 1.1993          | 0.8334   | 0.8107      | 0.8559      | 0.8288   | 0.8935 |
| 0.0002        | 37.1991 | 17000 | 1.0206          | 0.8374   | 0.8652      | 0.8098      | 0.8410   | 0.9128 |
| 0.0024        | 37.4179 | 17100 | 0.9984          | 0.8359   | 0.7899      | 0.8814      | 0.8272   | 0.9094 |
| 0.0005        | 37.6368 | 17200 | 1.1162          | 0.8388   | 0.7671      | 0.9098      | 0.8256   | 0.8987 |
| 0.0008        | 37.8556 | 17300 | 0.9434          | 0.8433   | 0.8414      | 0.8451      | 0.8423   | 0.9146 |
| 0.0003        | 38.0744 | 17400 | 0.9508          | 0.8457   | 0.8523      | 0.8392      | 0.8460   | 0.9200 |
| 0.0003        | 38.2932 | 17500 | 1.0299          | 0.8379   | 0.8345      | 0.8412      | 0.8366   | 0.9183 |
| 0.0002        | 38.5120 | 17600 | 1.0518          | 0.8438   | 0.8325      | 0.8549      | 0.8413   | 0.9178 |
| 0.0015        | 38.7309 | 17700 | 1.0205          | 0.8472   | 0.8464      | 0.8480      | 0.8464   | 0.9210 |
| 0.0188        | 38.9497 | 17800 | 1.0644          | 0.8438   | 0.7968      | 0.8902      | 0.8353   | 0.9183 |
| 0.0002        | 39.1685 | 17900 | 1.0497          | 0.8443   | 0.8266      | 0.8618      | 0.8407   | 0.9220 |
| 0.0003        | 39.3873 | 18000 | 1.0802          | 0.8443   | 0.8236      | 0.8647      | 0.8402   | 0.9210 |
| 0.0002        | 39.6061 | 18100 | 1.1465          | 0.8393   | 0.7958      | 0.8824      | 0.8313   | 0.9186 |
| 0.0002        | 39.8249 | 18200 | 1.0551          | 0.8467   | 0.8147      | 0.8784      | 0.8409   | 0.9185 |
| 0.0002        | 40.0438 | 18300 | 1.0791          | 0.8467   | 0.8147      | 0.8784      | 0.8409   | 0.9171 |
| 0.0002        | 40.2626 | 18400 | 1.0902          | 0.8487   | 0.8176      | 0.8794      | 0.8431   | 0.9175 |
| 0.0002        | 40.4814 | 18500 | 1.1028          | 0.8487   | 0.8176      | 0.8794      | 0.8431   | 0.9175 |
| 0.0001        | 40.7002 | 18600 | 1.1156          | 0.8487   | 0.8176      | 0.8794      | 0.8431   | 0.9165 |
| 0.0001        | 40.9190 | 18700 | 1.1266          | 0.8487   | 0.8176      | 0.8794      | 0.8431   | 0.9168 |
| 0.0002        | 41.1379 | 18800 | 1.0527          | 0.8472   | 0.8246      | 0.8696      | 0.8430   | 0.9186 |
| 0.0002        | 41.3567 | 18900 | 1.0758          | 0.8477   | 0.8226      | 0.8725      | 0.8431   | 0.9190 |
| 0.0001        | 41.5755 | 19000 | 1.0940          | 0.8492   | 0.8216      | 0.8765      | 0.8442   | 0.9199 |
| 0.0268        | 41.7943 | 19100 | 0.9887          | 0.8374   | 0.8494      | 0.8255      | 0.8386   | 0.9196 |
| 0.002         | 42.0131 | 19200 | 1.0890          | 0.8354   | 0.7730      | 0.8971      | 0.8237   | 0.9172 |
| 0.0002        | 42.2319 | 19300 | 1.0668          | 0.8418   | 0.8147      | 0.8686      | 0.8366   | 0.9154 |
| 0.0001        | 42.4508 | 19400 | 1.1239          | 0.8383   | 0.7899      | 0.8863      | 0.8293   | 0.9150 |
| 0.0001        | 42.6696 | 19500 | 1.1372          | 0.8364   | 0.8285      | 0.8441      | 0.8343   | 0.9084 |
| 0.0001        | 42.8884 | 19600 | 1.1153          | 0.8393   | 0.7869      | 0.8912      | 0.8297   | 0.9200 |
| 0.0001        | 43.1072 | 19700 | 1.1482          | 0.8413   | 0.7790      | 0.9029      | 0.8300   | 0.9184 |
| 0.0001        | 43.3260 | 19800 | 1.1535          | 0.8388   | 0.7859      | 0.8912      | 0.8291   | 0.9180 |
| 0.0001        | 43.5449 | 19900 | 1.1138          | 0.8393   | 0.8236      | 0.8549      | 0.8360   | 0.9188 |
| 0.0001        | 43.7637 | 20000 | 1.1321          | 0.8393   | 0.8186      | 0.8598      | 0.8352   | 0.9176 |
| 0.0001        | 43.9825 | 20100 | 1.1473          | 0.8403   | 0.8147      | 0.8657      | 0.8354   | 0.9163 |
| 0.0001        | 44.2013 | 20200 | 1.1550          | 0.8413   | 0.8137      | 0.8686      | 0.8360   | 0.9154 |
| 0.0001        | 44.4201 | 20300 | 1.1630          | 0.8428   | 0.8127      | 0.8725      | 0.8372   | 0.9143 |
| 0.0001        | 44.6389 | 20400 | 1.1718          | 0.8428   | 0.8117      | 0.8735      | 0.8370   | 0.9133 |
| 0.0001        | 44.8578 | 20500 | 1.1793          | 0.8428   | 0.8117      | 0.8735      | 0.8370   | 0.9129 |
| 0.0001        | 45.0766 | 20600 | 1.1869          | 0.8418   | 0.8097      | 0.8735      | 0.8358   | 0.9121 |
| 0.0001        | 45.2954 | 20700 | 1.1931          | 0.8413   | 0.8087      | 0.8735      | 0.8352   | 0.9115 |
| 0.0001        | 45.5142 | 20800 | 1.1990          | 0.8418   | 0.8097      | 0.8735      | 0.8358   | 0.9103 |
| 0.0001        | 45.7330 | 20900 | 1.2056          | 0.8418   | 0.8087      | 0.8745      | 0.8356   | 0.9097 |
| 0.0001        | 45.9519 | 21000 | 1.2116          | 0.8423   | 0.8087      | 0.8755      | 0.8361   | 0.9092 |
| 0.0001        | 46.1707 | 21100 | 1.2176          | 0.8428   | 0.8087      | 0.8765      | 0.8365   | 0.9090 |
| 0.0001        | 46.3895 | 21200 | 1.2233          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9082 |
| 0.0001        | 46.6083 | 21300 | 1.2281          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9079 |
| 0.0001        | 46.8271 | 21400 | 1.2322          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9075 |
| 0.0001        | 47.0460 | 21500 | 1.2365          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9075 |
| 0.0001        | 47.2648 | 21600 | 1.2402          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9074 |
| 0.0001        | 47.4836 | 21700 | 1.2447          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9060 |
| 0.0001        | 47.7024 | 21800 | 1.2484          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9068 |
| 0.0001        | 47.9212 | 21900 | 1.2516          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9064 |
| 0.0           | 48.1400 | 22000 | 1.2546          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9068 |
| 0.0           | 48.3589 | 22100 | 1.2572          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9062 |
| 0.0           | 48.5777 | 22200 | 1.2603          | 0.8433   | 0.8087      | 0.8775      | 0.8369   | 0.9058 |
| 0.0           | 48.7965 | 22300 | 1.2628          | 0.8438   | 0.8087      | 0.8784      | 0.8374   | 0.9057 |
| 0.0           | 49.0153 | 22400 | 1.2647          | 0.8438   | 0.8087      | 0.8784      | 0.8374   | 0.9053 |
| 0.0           | 49.2341 | 22500 | 1.2663          | 0.8438   | 0.8087      | 0.8784      | 0.8374   | 0.9055 |
| 0.0           | 49.4530 | 22600 | 1.2679          | 0.8438   | 0.8087      | 0.8784      | 0.8374   | 0.9058 |
| 0.0           | 49.6718 | 22700 | 1.2687          | 0.8438   | 0.8087      | 0.8784      | 0.8374   | 0.9057 |
| 0.0           | 49.8906 | 22800 | 1.2691          | 0.8438   | 0.8087      | 0.8784      | 0.8374   | 0.9061 |


### Framework versions

- Transformers 4.47.1
- Pytorch 2.5.1+cu121
- Datasets 2.20.0
- Tokenizers 0.21.0