File size: 3,108 Bytes
e8e4d22 075daa8 8cdee31 075daa8 8cdee31 075daa8 8cdee31 075daa8 8cdee31 075daa8 e8e4d22 075daa8 e8e4d22 075daa8 8cdee31 075daa8 8cdee31 075daa8 8cdee31 075daa8 e8e4d22 075daa8 e8e4d22 075daa8 8cdee31 e8e4d22 075daa8 e8e4d22 075daa8 e8e4d22 075daa8 e8e4d22 075daa8 e8e4d22 075daa8 e8e4d22 075daa8 700afaf ced9a6e 53d78f0 4cba82a 1669fc8 efea089 bb63abe dd205b1 daacdd6 250a688 fcba00c 9813db6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-17T05:45:08'
project_name: ThunBERT_bs64_lr4_emissions_tracker
run_id: d2c6dcba-9ae6-44ee-920e-d6a98f77cc7e
duration: 158953.8123600483
emissions: 0.1663746335150697
emissions_rate: 1.0466853927240982e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 1.87653561675366
gpu_energy: 0
ram_energy: 1.6557595259199582
energy_consumed: 3.5322951426736116
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 158953.8123600483 |
| Emissions (Co2eq in kg) | 0.1663746335150697 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 1.87653561675366 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 1.6557595259199582 |
| Consumed energy (kWh) | 3.5322951426736116 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.30598608879309297 |
| Emissions (Co2eq in kg) | 0.062256909841018906 |
## Note
15 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs64_lr4 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0005 |
| batch_size | 64 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 10263 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 6.820532 | 11.810026 |
| 0.5 | 4.147990 | 3.898213 |
| 1.0 | 3.784049 | 3.836403 |
| 1.5 | 7.045870 | 7.716833 |
| 2.0 | 7.670383 | 7.707286 |
| 2.5 | 7.666404 | 7.691573 |
| 3.0 | 7.656751 | 7.687526 |
| 3.5 | 7.654266 | 7.679237 |
| 4.0 | 7.644708 | 7.664175 |
| 4.5 | 7.641661 | 7.666334 |
| 5.0 | 7.638564 | 7.655856 |
| 5.5 | 7.625011 | 7.645496 |
| 6.0 | 7.626149 | 7.648783 |
|