File size: 3,110 Bytes
011c3a0 2347fb9 e1741fe 011c3a0 2347fb9 011c3a0 2347fb9 e1741fe 2347fb9 e1741fe 2347fb9 e1741fe 011c3a0 2347fb9 011c3a0 2347fb9 e1741fe 011c3a0 2347fb9 011c3a0 2347fb9 011c3a0 2347fb9 011c3a0 2347fb9 011c3a0 2347fb9 011c3a0 2347fb9 28516ee f1d06f3 6af70e8 bd08689 826152b 4be972d 1983a4b 1de3ca7 89e972a fa131f3 fc61e30 74fa0b3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-11T11:05:29'
project_name: ThunBERT_bs64_lr5_emissions_tracker
run_id: a7add227-dc6d-4692-9097-adff51c16232
duration: 159163.96356463432
emissions: 0.1665945345676245
emissions_rate: 1.0466850085696238e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 1.8790164295088856
gpu_energy: 0
ram_energy: 1.6579474261974336
energy_consumed: 3.5369638557063454
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 159163.96356463432 |
| Emissions (Co2eq in kg) | 0.1665945345676245 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 1.8790164295088856 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 1.6579474261974336 |
| Consumed energy (kWh) | 3.5369638557063454 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.30639062986192106 |
| Emissions (Co2eq in kg) | 0.06233921906281511 |
## Note
9 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs64_lr5 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 64 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 10332 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 6.909546 | 4.164706 |
| 0.5 | 2.997779 | 2.971092 |
| 1.0 | 2.825093 | 2.881237 |
| 1.5 | 2.760029 | 2.842839 |
| 2.0 | 2.690453 | 2.804439 |
| 2.5 | 2.642067 | 2.759108 |
| 3.0 | 2.609351 | 2.711806 |
| 3.5 | 2.563262 | 2.682030 |
| 4.0 | 2.526233 | 2.664100 |
| 4.5 | 2.484387 | 2.630369 |
| 5.0 | 2.452856 | 2.621543 |
| 5.5 | 2.420350 | 2.589874 |
| 6.0 | 2.417808 | 2.582526 |
|