File size: 3,105 Bytes
74a8e32 f2fa75c 5f211dd f2fa75c 5f211dd f2fa75c 5f211dd f2fa75c 5f211dd f2fa75c 74a8e32 f2fa75c 74a8e32 f2fa75c 5f211dd f2fa75c 5f211dd f2fa75c 5f211dd f2fa75c 74a8e32 f2fa75c 74a8e32 f2fa75c 5f211dd 74a8e32 f2fa75c 74a8e32 f2fa75c 74a8e32 f2fa75c 74a8e32 f2fa75c 74a8e32 f2fa75c 74a8e32 f2fa75c ee8d5be caec4cf b6b48b2 36c45af 2be4d13 92d2756 0b8fad3 b1f320f bf26b9d 47b5216 d15d18a 11d5c4a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-17T12:35:37'
project_name: ThunBERT_bs32_lr5_emissions_tracker
run_id: bb30bce0-dc39-4380-9fb8-0368180d020b
duration: 180540.8281199932
emissions: 0.1889692277270039
emissions_rate: 1.046684174957971e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.1313811261523066
gpu_energy: 0
ram_energy: 1.8806192077472823
energy_consumed: 4.012000333899577
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 180540.8281199932 |
| Emissions (Co2eq in kg) | 0.1889692277270039 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.1313811261523066 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 1.8806192077472823 |
| Consumed energy (kWh) | 4.012000333899577 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3475410941309869 |
| Emissions (Co2eq in kg) | 0.07071182434699733 |
## Note
15 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs32_lr5 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 32 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 20393 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 4.767287 | 3.817442 |
| 0.5 | 3.344291 | 3.201500 |
| 1.0 | 3.131225 | 3.044940 |
| 1.5 | 2.992692 | 2.967517 |
| 2.0 | 2.911544 | 2.897029 |
| 2.5 | 2.861460 | 2.844424 |
| 3.0 | 2.797808 | 2.814696 |
| 3.5 | 2.738420 | 2.776461 |
| 4.0 | 2.698689 | 2.730229 |
| 4.5 | 2.671872 | 2.693672 |
| 5.0 | 2.628263 | 2.662948 |
| 5.5 | 2.587204 | 2.639905 |
| 6.0 | 2.565847 | 2.620656 |
|