File size: 2,632 Bytes
523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 523f390 c3013bc 81cc926 aa15517 9e7a8b5 19bb993 99646b2 3d0aaa8 a8981f1 bbe27d3 645b47f 46cd883 afe4759 0ab70aa b99e58c 9270247 3955e45 7bef177 29e2081 6f10f56 35c2766 adea068 f25d5f0 6673e30 8cf6b47 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 |
---
language: en
tags:
- fill-mask
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | [More Information Needed] |
| Emissions (Co2eq in kg) | [More Information Needed] |
| CPU power (W) | [NO CPU] |
| GPU power (W) | [No GPU] |
| RAM power (W) | [More Information Needed] |
| CPU energy (kWh) | [No CPU] |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | [More Information Needed] |
| Consumed energy (kWh) | [More Information Needed] |
| Country name | [More Information Needed] |
| Cloud provider | [No Cloud] |
| Cloud region | [No Cloud] |
| CPU count | [No CPU] |
| CPU model | [No CPU] |
| GPU count | [No GPU] |
| GPU model | [No GPU] |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | [No CPU] |
| Emissions (Co2eq in kg) | [More Information Needed] |
## Note
30 April 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | BERTrand_bs16_lr6 |
| sequence_length | 400 |
| num_epoch | 12 |
| learning_rate | 5e-06 |
| batch_size | 16 |
| weight_decay | 0.0 |
| warm_up_prop | 0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 12597 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.499363 | 15.126202 |
| 0.5 | 8.243008 | 8.091313 |
| 1.0 | 7.354550 | 7.973097 |
| 1.5 | 7.244512 | 7.687902 |
| 2.0 | 7.199471 | 7.686438 |
| 2.5 | 7.161911 | 7.657964 |
| 3.0 | 7.049606 | 7.765894 |
| 3.5 | 7.091233 | 7.786471 |
| 4.0 | 7.060327 | 7.814007 |
| 4.5 | 7.164975 | 7.602441 |
| 5.0 | 7.008690 | 7.586652 |
| 5.5 | 7.035732 | 7.525334 |
| 6.0 | 7.045719 | 7.715493 |
| 6.5 | 7.108394 | 7.486681 |
| 7.0 | 6.992529 | 7.641908 |
| 7.5 | 6.993111 | 7.575982 |
| 8.0 | 7.051304 | 7.670884 |
| 8.5 | 7.075128 | 7.527084 |
| 9.0 | 7.010871 | 7.556140 |
| 9.5 | 6.978617 | 7.623441 |
| 10.0 | 7.033166 | 7.562979 |
| 10.5 | 7.026733 | 7.549661 |
| 11.0 | 7.080350 | 7.510597 |
| 11.5 | 6.955319 | 7.589880 |
|