File size: 22,013 Bytes
7855927
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
---
base_model: anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test
tags:
- audio-classification
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: HuggingfaceTest
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# HuggingfaceTest

This model is a fine-tuned version of [anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test](https://huggingface.co/anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test) on the anderloh/Master5Class dataset.
It achieves the following results on the evaluation set:
- Loss: 0.8156
- Accuracy: 0.7028

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 128
- eval_batch_size: 128
- seed: 0
- gradient_accumulation_steps: 4
- total_train_batch_size: 512
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 350.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch  | Step | Validation Loss | Accuracy |
|:-------------:|:------:|:----:|:---------------:|:--------:|
| No log        | 0.92   | 3    | 1.5989          | 0.3427   |
| No log        | 1.85   | 6    | 1.5988          | 0.3427   |
| No log        | 2.77   | 9    | 1.5986          | 0.3427   |
| No log        | 4.0    | 13   | 1.5981          | 0.3427   |
| No log        | 4.92   | 16   | 1.5976          | 0.3357   |
| No log        | 5.85   | 19   | 1.5970          | 0.3427   |
| No log        | 6.77   | 22   | 1.5963          | 0.3392   |
| No log        | 8.0    | 26   | 1.5953          | 0.3357   |
| No log        | 8.92   | 29   | 1.5943          | 0.3287   |
| No log        | 9.85   | 32   | 1.5933          | 0.3287   |
| No log        | 10.77  | 35   | 1.5922          | 0.3217   |
| No log        | 12.0   | 39   | 1.5906          | 0.3182   |
| No log        | 12.92  | 42   | 1.5892          | 0.3147   |
| No log        | 13.85  | 45   | 1.5877          | 0.3007   |
| No log        | 14.77  | 48   | 1.5862          | 0.2937   |
| 1.5907        | 16.0   | 52   | 1.5841          | 0.2972   |
| 1.5907        | 16.92  | 55   | 1.5824          | 0.2832   |
| 1.5907        | 17.85  | 58   | 1.5806          | 0.2797   |
| 1.5907        | 18.77  | 61   | 1.5788          | 0.2692   |
| 1.5907        | 20.0   | 65   | 1.5762          | 0.2692   |
| 1.5907        | 20.92  | 68   | 1.5740          | 0.2657   |
| 1.5907        | 21.85  | 71   | 1.5717          | 0.2552   |
| 1.5907        | 22.77  | 74   | 1.5694          | 0.2517   |
| 1.5907        | 24.0   | 78   | 1.5661          | 0.2378   |
| 1.5907        | 24.92  | 81   | 1.5635          | 0.2343   |
| 1.5907        | 25.85  | 84   | 1.5608          | 0.2238   |
| 1.5907        | 26.77  | 87   | 1.5581          | 0.2238   |
| 1.5907        | 28.0   | 91   | 1.5542          | 0.2273   |
| 1.5907        | 28.92  | 94   | 1.5511          | 0.2273   |
| 1.5907        | 29.85  | 97   | 1.5479          | 0.2273   |
| 1.5431        | 30.77  | 100  | 1.5448          | 0.2273   |
| 1.5431        | 32.0   | 104  | 1.5408          | 0.2273   |
| 1.5431        | 32.92  | 107  | 1.5380          | 0.2273   |
| 1.5431        | 33.85  | 110  | 1.5359          | 0.2273   |
| 1.5431        | 34.77  | 113  | 1.5345          | 0.2273   |
| 1.5431        | 36.0   | 117  | 1.5335          | 0.2273   |
| 1.5431        | 36.92  | 120  | 1.5341          | 0.2273   |
| 1.5431        | 37.85  | 123  | 1.5361          | 0.2273   |
| 1.5431        | 38.77  | 126  | 1.5397          | 0.2273   |
| 1.5431        | 40.0   | 130  | 1.5479          | 0.2273   |
| 1.5431        | 40.92  | 133  | 1.5564          | 0.2273   |
| 1.5431        | 41.85  | 136  | 1.5679          | 0.2273   |
| 1.5431        | 42.77  | 139  | 1.5822          | 0.2273   |
| 1.5431        | 44.0   | 143  | 1.6002          | 0.2273   |
| 1.5431        | 44.92  | 146  | 1.6109          | 0.2273   |
| 1.5431        | 45.85  | 149  | 1.6146          | 0.2273   |
| 1.4033        | 46.77  | 152  | 1.6131          | 0.2273   |
| 1.4033        | 48.0   | 156  | 1.6008          | 0.2273   |
| 1.4033        | 48.92  | 159  | 1.5862          | 0.2413   |
| 1.4033        | 49.85  | 162  | 1.5726          | 0.2692   |
| 1.4033        | 50.77  | 165  | 1.5599          | 0.2692   |
| 1.4033        | 52.0   | 169  | 1.5459          | 0.2867   |
| 1.4033        | 52.92  | 172  | 1.5383          | 0.2937   |
| 1.4033        | 53.85  | 175  | 1.5311          | 0.3147   |
| 1.4033        | 54.77  | 178  | 1.5242          | 0.3252   |
| 1.4033        | 56.0   | 182  | 1.5169          | 0.3357   |
| 1.4033        | 56.92  | 185  | 1.5103          | 0.3427   |
| 1.4033        | 57.85  | 188  | 1.5056          | 0.3462   |
| 1.4033        | 58.77  | 191  | 1.4995          | 0.3462   |
| 1.4033        | 60.0   | 195  | 1.4939          | 0.3497   |
| 1.4033        | 60.92  | 198  | 1.4870          | 0.3601   |
| 1.2485        | 61.85  | 201  | 1.4829          | 0.3671   |
| 1.2485        | 62.77  | 204  | 1.4735          | 0.3741   |
| 1.2485        | 64.0   | 208  | 1.4612          | 0.3811   |
| 1.2485        | 64.92  | 211  | 1.4492          | 0.3986   |
| 1.2485        | 65.85  | 214  | 1.4365          | 0.4126   |
| 1.2485        | 66.77  | 217  | 1.4227          | 0.4231   |
| 1.2485        | 68.0   | 221  | 1.4096          | 0.4336   |
| 1.2485        | 68.92  | 224  | 1.4010          | 0.4371   |
| 1.2485        | 69.85  | 227  | 1.3950          | 0.4406   |
| 1.2485        | 70.77  | 230  | 1.3920          | 0.4371   |
| 1.2485        | 72.0   | 234  | 1.3799          | 0.4406   |
| 1.2485        | 72.92  | 237  | 1.3669          | 0.4476   |
| 1.2485        | 73.85  | 240  | 1.3515          | 0.4545   |
| 1.2485        | 74.77  | 243  | 1.3401          | 0.4720   |
| 1.2485        | 76.0   | 247  | 1.3286          | 0.4825   |
| 1.1198        | 76.92  | 250  | 1.3175          | 0.4860   |
| 1.1198        | 77.85  | 253  | 1.3067          | 0.4895   |
| 1.1198        | 78.77  | 256  | 1.3013          | 0.4825   |
| 1.1198        | 80.0   | 260  | 1.2954          | 0.4790   |
| 1.1198        | 80.92  | 263  | 1.2897          | 0.4860   |
| 1.1198        | 81.85  | 266  | 1.2832          | 0.4860   |
| 1.1198        | 82.77  | 269  | 1.2712          | 0.4825   |
| 1.1198        | 84.0   | 273  | 1.2584          | 0.4930   |
| 1.1198        | 84.92  | 276  | 1.2516          | 0.4965   |
| 1.1198        | 85.85  | 279  | 1.2456          | 0.5      |
| 1.1198        | 86.77  | 282  | 1.2444          | 0.5105   |
| 1.1198        | 88.0   | 286  | 1.2373          | 0.5105   |
| 1.1198        | 88.92  | 289  | 1.2309          | 0.5140   |
| 1.1198        | 89.85  | 292  | 1.2219          | 0.5210   |
| 1.1198        | 90.77  | 295  | 1.2145          | 0.5210   |
| 1.1198        | 92.0   | 299  | 1.2054          | 0.5280   |
| 0.9915        | 92.92  | 302  | 1.1982          | 0.5350   |
| 0.9915        | 93.85  | 305  | 1.1913          | 0.5385   |
| 0.9915        | 94.77  | 308  | 1.1859          | 0.5455   |
| 0.9915        | 96.0   | 312  | 1.1794          | 0.5490   |
| 0.9915        | 96.92  | 315  | 1.1734          | 0.5455   |
| 0.9915        | 97.85  | 318  | 1.1638          | 0.5524   |
| 0.9915        | 98.77  | 321  | 1.1550          | 0.5524   |
| 0.9915        | 100.0  | 325  | 1.1465          | 0.5490   |
| 0.9915        | 100.92 | 328  | 1.1444          | 0.5594   |
| 0.9915        | 101.85 | 331  | 1.1359          | 0.5629   |
| 0.9915        | 102.77 | 334  | 1.1271          | 0.5664   |
| 0.9915        | 104.0  | 338  | 1.1090          | 0.5769   |
| 0.9915        | 104.92 | 341  | 1.0972          | 0.5944   |
| 0.9915        | 105.85 | 344  | 1.0901          | 0.6014   |
| 0.9915        | 106.77 | 347  | 1.0809          | 0.6084   |
| 0.8834        | 108.0  | 351  | 1.0683          | 0.6119   |
| 0.8834        | 108.92 | 354  | 1.0605          | 0.6224   |
| 0.8834        | 109.85 | 357  | 1.0563          | 0.6259   |
| 0.8834        | 110.77 | 360  | 1.0538          | 0.6224   |
| 0.8834        | 112.0  | 364  | 1.0491          | 0.6154   |
| 0.8834        | 112.92 | 367  | 1.0441          | 0.6119   |
| 0.8834        | 113.85 | 370  | 1.0358          | 0.6119   |
| 0.8834        | 114.77 | 373  | 1.0194          | 0.6224   |
| 0.8834        | 116.0  | 377  | 1.0034          | 0.6294   |
| 0.8834        | 116.92 | 380  | 0.9991          | 0.6259   |
| 0.8834        | 117.85 | 383  | 0.9960          | 0.6259   |
| 0.8834        | 118.77 | 386  | 0.9911          | 0.6294   |
| 0.8834        | 120.0  | 390  | 0.9834          | 0.6434   |
| 0.8834        | 120.92 | 393  | 0.9776          | 0.6434   |
| 0.8834        | 121.85 | 396  | 0.9773          | 0.6434   |
| 0.8834        | 122.77 | 399  | 0.9735          | 0.6434   |
| 0.7786        | 124.0  | 403  | 0.9731          | 0.6399   |
| 0.7786        | 124.92 | 406  | 0.9728          | 0.6434   |
| 0.7786        | 125.85 | 409  | 0.9657          | 0.6573   |
| 0.7786        | 126.77 | 412  | 0.9548          | 0.6573   |
| 0.7786        | 128.0  | 416  | 0.9424          | 0.6643   |
| 0.7786        | 128.92 | 419  | 0.9391          | 0.6678   |
| 0.7786        | 129.85 | 422  | 0.9418          | 0.6678   |
| 0.7786        | 130.77 | 425  | 0.9476          | 0.6608   |
| 0.7786        | 132.0  | 429  | 0.9457          | 0.6643   |
| 0.7786        | 132.92 | 432  | 0.9413          | 0.6643   |
| 0.7786        | 133.85 | 435  | 0.9334          | 0.6678   |
| 0.7786        | 134.77 | 438  | 0.9329          | 0.6678   |
| 0.7786        | 136.0  | 442  | 0.9334          | 0.6713   |
| 0.7786        | 136.92 | 445  | 0.9265          | 0.6713   |
| 0.7786        | 137.85 | 448  | 0.9187          | 0.6713   |
| 0.7133        | 138.77 | 451  | 0.9169          | 0.6678   |
| 0.7133        | 140.0  | 455  | 0.9142          | 0.6713   |
| 0.7133        | 140.92 | 458  | 0.9131          | 0.6713   |
| 0.7133        | 141.85 | 461  | 0.9161          | 0.6783   |
| 0.7133        | 142.77 | 464  | 0.9224          | 0.6678   |
| 0.7133        | 144.0  | 468  | 0.9139          | 0.6748   |
| 0.7133        | 144.92 | 471  | 0.9090          | 0.6748   |
| 0.7133        | 145.85 | 474  | 0.9073          | 0.6713   |
| 0.7133        | 146.77 | 477  | 0.9110          | 0.6608   |
| 0.7133        | 148.0  | 481  | 0.9167          | 0.6573   |
| 0.7133        | 148.92 | 484  | 0.9118          | 0.6643   |
| 0.7133        | 149.85 | 487  | 0.8996          | 0.6713   |
| 0.7133        | 150.77 | 490  | 0.8904          | 0.6748   |
| 0.7133        | 152.0  | 494  | 0.8889          | 0.6748   |
| 0.7133        | 152.92 | 497  | 0.8899          | 0.6713   |
| 0.6674        | 153.85 | 500  | 0.8874          | 0.6748   |
| 0.6674        | 154.77 | 503  | 0.8874          | 0.6748   |
| 0.6674        | 156.0  | 507  | 0.8905          | 0.6748   |
| 0.6674        | 156.92 | 510  | 0.8881          | 0.6783   |
| 0.6674        | 157.85 | 513  | 0.8829          | 0.6748   |
| 0.6674        | 158.77 | 516  | 0.8809          | 0.6783   |
| 0.6674        | 160.0  | 520  | 0.8781          | 0.6783   |
| 0.6674        | 160.92 | 523  | 0.8776          | 0.6818   |
| 0.6674        | 161.85 | 526  | 0.8796          | 0.6783   |
| 0.6674        | 162.77 | 529  | 0.8795          | 0.6818   |
| 0.6674        | 164.0  | 533  | 0.8797          | 0.6783   |
| 0.6674        | 164.92 | 536  | 0.8707          | 0.6783   |
| 0.6674        | 165.85 | 539  | 0.8697          | 0.6783   |
| 0.6674        | 166.77 | 542  | 0.8724          | 0.6783   |
| 0.6674        | 168.0  | 546  | 0.8704          | 0.6748   |
| 0.6674        | 168.92 | 549  | 0.8694          | 0.6748   |
| 0.6305        | 169.85 | 552  | 0.8740          | 0.6748   |
| 0.6305        | 170.77 | 555  | 0.8713          | 0.6748   |
| 0.6305        | 172.0  | 559  | 0.8682          | 0.6783   |
| 0.6305        | 172.92 | 562  | 0.8688          | 0.6783   |
| 0.6305        | 173.85 | 565  | 0.8693          | 0.6818   |
| 0.6305        | 174.77 | 568  | 0.8744          | 0.6783   |
| 0.6305        | 176.0  | 572  | 0.8760          | 0.6783   |
| 0.6305        | 176.92 | 575  | 0.8696          | 0.6853   |
| 0.6305        | 177.85 | 578  | 0.8669          | 0.6853   |
| 0.6305        | 178.77 | 581  | 0.8641          | 0.6853   |
| 0.6305        | 180.0  | 585  | 0.8697          | 0.6713   |
| 0.6305        | 180.92 | 588  | 0.8678          | 0.6748   |
| 0.6305        | 181.85 | 591  | 0.8621          | 0.6818   |
| 0.6305        | 182.77 | 594  | 0.8557          | 0.6888   |
| 0.6305        | 184.0  | 598  | 0.8481          | 0.6888   |
| 0.6095        | 184.92 | 601  | 0.8429          | 0.6888   |
| 0.6095        | 185.85 | 604  | 0.8413          | 0.6888   |
| 0.6095        | 186.77 | 607  | 0.8402          | 0.6923   |
| 0.6095        | 188.0  | 611  | 0.8415          | 0.6888   |
| 0.6095        | 188.92 | 614  | 0.8410          | 0.6923   |
| 0.6095        | 189.85 | 617  | 0.8389          | 0.6853   |
| 0.6095        | 190.77 | 620  | 0.8354          | 0.6853   |
| 0.6095        | 192.0  | 624  | 0.8357          | 0.6888   |
| 0.6095        | 192.92 | 627  | 0.8401          | 0.6958   |
| 0.6095        | 193.85 | 630  | 0.8449          | 0.6958   |
| 0.6095        | 194.77 | 633  | 0.8479          | 0.6958   |
| 0.6095        | 196.0  | 637  | 0.8455          | 0.6923   |
| 0.6095        | 196.92 | 640  | 0.8422          | 0.6923   |
| 0.6095        | 197.85 | 643  | 0.8425          | 0.6923   |
| 0.6095        | 198.77 | 646  | 0.8437          | 0.6923   |
| 0.5908        | 200.0  | 650  | 0.8367          | 0.6958   |
| 0.5908        | 200.92 | 653  | 0.8347          | 0.6993   |
| 0.5908        | 201.85 | 656  | 0.8287          | 0.6958   |
| 0.5908        | 202.77 | 659  | 0.8260          | 0.6923   |
| 0.5908        | 204.0  | 663  | 0.8264          | 0.6958   |
| 0.5908        | 204.92 | 666  | 0.8295          | 0.6958   |
| 0.5908        | 205.85 | 669  | 0.8302          | 0.6923   |
| 0.5908        | 206.77 | 672  | 0.8285          | 0.6923   |
| 0.5908        | 208.0  | 676  | 0.8311          | 0.6923   |
| 0.5908        | 208.92 | 679  | 0.8321          | 0.6923   |
| 0.5908        | 209.85 | 682  | 0.8306          | 0.6923   |
| 0.5908        | 210.77 | 685  | 0.8303          | 0.6923   |
| 0.5908        | 212.0  | 689  | 0.8256          | 0.6993   |
| 0.5908        | 212.92 | 692  | 0.8230          | 0.6958   |
| 0.5908        | 213.85 | 695  | 0.8194          | 0.6958   |
| 0.5908        | 214.77 | 698  | 0.8183          | 0.6958   |
| 0.5763        | 216.0  | 702  | 0.8232          | 0.6958   |
| 0.5763        | 216.92 | 705  | 0.8237          | 0.6888   |
| 0.5763        | 217.85 | 708  | 0.8196          | 0.6993   |
| 0.5763        | 218.77 | 711  | 0.8142          | 0.6993   |
| 0.5763        | 220.0  | 715  | 0.8115          | 0.6993   |
| 0.5763        | 220.92 | 718  | 0.8130          | 0.6993   |
| 0.5763        | 221.85 | 721  | 0.8156          | 0.7028   |
| 0.5763        | 222.77 | 724  | 0.8201          | 0.6958   |
| 0.5763        | 224.0  | 728  | 0.8227          | 0.6958   |
| 0.5763        | 224.92 | 731  | 0.8232          | 0.6958   |
| 0.5763        | 225.85 | 734  | 0.8198          | 0.6923   |
| 0.5763        | 226.77 | 737  | 0.8151          | 0.6923   |
| 0.5763        | 228.0  | 741  | 0.8136          | 0.6923   |
| 0.5763        | 228.92 | 744  | 0.8134          | 0.6923   |
| 0.5763        | 229.85 | 747  | 0.8123          | 0.6958   |
| 0.57          | 230.77 | 750  | 0.8095          | 0.6958   |
| 0.57          | 232.0  | 754  | 0.8082          | 0.6958   |
| 0.57          | 232.92 | 757  | 0.8084          | 0.6958   |
| 0.57          | 233.85 | 760  | 0.8114          | 0.6923   |
| 0.57          | 234.77 | 763  | 0.8130          | 0.6923   |
| 0.57          | 236.0  | 767  | 0.8154          | 0.6923   |
| 0.57          | 236.92 | 770  | 0.8160          | 0.6923   |
| 0.57          | 237.85 | 773  | 0.8126          | 0.6888   |
| 0.57          | 238.77 | 776  | 0.8114          | 0.6888   |
| 0.57          | 240.0  | 780  | 0.8041          | 0.6923   |
| 0.57          | 240.92 | 783  | 0.8006          | 0.6923   |
| 0.57          | 241.85 | 786  | 0.7987          | 0.6958   |
| 0.57          | 242.77 | 789  | 0.7977          | 0.6993   |
| 0.57          | 244.0  | 793  | 0.8001          | 0.6993   |
| 0.57          | 244.92 | 796  | 0.8044          | 0.6958   |
| 0.57          | 245.85 | 799  | 0.8082          | 0.6958   |
| 0.5456        | 246.77 | 802  | 0.8121          | 0.6888   |
| 0.5456        | 248.0  | 806  | 0.8107          | 0.6888   |
| 0.5456        | 248.92 | 809  | 0.8064          | 0.6958   |
| 0.5456        | 249.85 | 812  | 0.8042          | 0.6958   |
| 0.5456        | 250.77 | 815  | 0.8006          | 0.6958   |
| 0.5456        | 252.0  | 819  | 0.7969          | 0.6958   |
| 0.5456        | 252.92 | 822  | 0.7955          | 0.6993   |
| 0.5456        | 253.85 | 825  | 0.7973          | 0.6958   |
| 0.5456        | 254.77 | 828  | 0.8001          | 0.6958   |
| 0.5456        | 256.0  | 832  | 0.8035          | 0.6888   |
| 0.5456        | 256.92 | 835  | 0.8035          | 0.6853   |
| 0.5456        | 257.85 | 838  | 0.8012          | 0.6923   |
| 0.5456        | 258.77 | 841  | 0.8000          | 0.6923   |
| 0.5456        | 260.0  | 845  | 0.7963          | 0.6888   |
| 0.5456        | 260.92 | 848  | 0.7928          | 0.6958   |
| 0.5369        | 261.85 | 851  | 0.7919          | 0.6923   |
| 0.5369        | 262.77 | 854  | 0.7913          | 0.6888   |
| 0.5369        | 264.0  | 858  | 0.7929          | 0.6888   |
| 0.5369        | 264.92 | 861  | 0.7955          | 0.6818   |
| 0.5369        | 265.85 | 864  | 0.7963          | 0.6853   |
| 0.5369        | 266.77 | 867  | 0.7952          | 0.6888   |
| 0.5369        | 268.0  | 871  | 0.7936          | 0.6888   |
| 0.5369        | 268.92 | 874  | 0.7929          | 0.6853   |
| 0.5369        | 269.85 | 877  | 0.7933          | 0.6853   |
| 0.5369        | 270.77 | 880  | 0.7941          | 0.6853   |
| 0.5369        | 272.0  | 884  | 0.7940          | 0.6853   |
| 0.5369        | 272.92 | 887  | 0.7929          | 0.6853   |
| 0.5369        | 273.85 | 890  | 0.7930          | 0.6853   |
| 0.5369        | 274.77 | 893  | 0.7943          | 0.6853   |
| 0.5369        | 276.0  | 897  | 0.7944          | 0.6853   |
| 0.5388        | 276.92 | 900  | 0.7933          | 0.6853   |
| 0.5388        | 277.85 | 903  | 0.7914          | 0.6853   |
| 0.5388        | 278.77 | 906  | 0.7904          | 0.6853   |
| 0.5388        | 280.0  | 910  | 0.7888          | 0.6853   |
| 0.5388        | 280.92 | 913  | 0.7900          | 0.6853   |
| 0.5388        | 281.85 | 916  | 0.7906          | 0.6853   |
| 0.5388        | 282.77 | 919  | 0.7911          | 0.6853   |
| 0.5388        | 284.0  | 923  | 0.7907          | 0.6853   |
| 0.5388        | 284.92 | 926  | 0.7907          | 0.6853   |
| 0.5388        | 285.85 | 929  | 0.7905          | 0.6818   |
| 0.5388        | 286.77 | 932  | 0.7900          | 0.6818   |
| 0.5388        | 288.0  | 936  | 0.7901          | 0.6853   |
| 0.5388        | 288.92 | 939  | 0.7902          | 0.6853   |
| 0.5388        | 289.85 | 942  | 0.7910          | 0.6853   |
| 0.5388        | 290.77 | 945  | 0.7914          | 0.6888   |
| 0.5388        | 292.0  | 949  | 0.7920          | 0.6888   |
| 0.5261        | 292.92 | 952  | 0.7928          | 0.6853   |
| 0.5261        | 293.85 | 955  | 0.7932          | 0.6888   |
| 0.5261        | 294.77 | 958  | 0.7925          | 0.6888   |
| 0.5261        | 296.0  | 962  | 0.7922          | 0.6888   |
| 0.5261        | 296.92 | 965  | 0.7919          | 0.6888   |
| 0.5261        | 297.85 | 968  | 0.7922          | 0.6888   |
| 0.5261        | 298.77 | 971  | 0.7921          | 0.6888   |
| 0.5261        | 300.0  | 975  | 0.7912          | 0.6853   |
| 0.5261        | 300.92 | 978  | 0.7907          | 0.6853   |
| 0.5261        | 301.85 | 981  | 0.7896          | 0.6853   |
| 0.5261        | 302.77 | 984  | 0.7885          | 0.6888   |
| 0.5261        | 304.0  | 988  | 0.7877          | 0.6888   |
| 0.5261        | 304.92 | 991  | 0.7874          | 0.6888   |
| 0.5261        | 305.85 | 994  | 0.7876          | 0.6888   |
| 0.5261        | 306.77 | 997  | 0.7879          | 0.6888   |
| 0.5188        | 308.0  | 1001 | 0.7884          | 0.6888   |
| 0.5188        | 308.92 | 1004 | 0.7887          | 0.6888   |
| 0.5188        | 309.85 | 1007 | 0.7890          | 0.6888   |
| 0.5188        | 310.77 | 1010 | 0.7894          | 0.6888   |
| 0.5188        | 312.0  | 1014 | 0.7899          | 0.6888   |
| 0.5188        | 312.92 | 1017 | 0.7904          | 0.6888   |
| 0.5188        | 313.85 | 1020 | 0.7907          | 0.6923   |
| 0.5188        | 314.77 | 1023 | 0.7910          | 0.6923   |
| 0.5188        | 316.0  | 1027 | 0.7912          | 0.6923   |
| 0.5188        | 316.92 | 1030 | 0.7912          | 0.6923   |
| 0.5188        | 317.85 | 1033 | 0.7912          | 0.6923   |
| 0.5188        | 318.77 | 1036 | 0.7913          | 0.6923   |
| 0.5188        | 320.0  | 1040 | 0.7913          | 0.6923   |
| 0.5188        | 320.92 | 1043 | 0.7912          | 0.6923   |
| 0.5188        | 321.85 | 1046 | 0.7912          | 0.6923   |
| 0.5188        | 322.77 | 1049 | 0.7911          | 0.6923   |
| 0.5194        | 323.08 | 1050 | 0.7911          | 0.6923   |


### Framework versions

- Transformers 4.39.0.dev0
- Pytorch 2.2.1+cu121
- Datasets 2.17.1
- Tokenizers 0.15.2