File size: 3,106 Bytes
d5a2580 a8dba1d 1ba0174 a8dba1d 1ba0174 a8dba1d 1ba0174 a8dba1d 1ba0174 a8dba1d d5a2580 a8dba1d d5a2580 a8dba1d 1ba0174 a8dba1d 1ba0174 a8dba1d 1ba0174 a8dba1d d5a2580 a8dba1d d5a2580 a8dba1d 1ba0174 d5a2580 a8dba1d d5a2580 a8dba1d d5a2580 a8dba1d d5a2580 a8dba1d d5a2580 a8dba1d d5a2580 a8dba1d 4fa6bbf 91b2417 190b8d9 88a7ba5 8212818 4f23fcf faf7425 6db224e b8dd52b 3666ec8 1ede3f9 6151e8a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-17T13:53:55'
project_name: ThunBERT_bs64_lr6_emissions_tracker
run_id: a684b01f-ae2d-4edd-8044-73026830f5f5
duration: 185122.32229161265
emissions: 0.1937646791643616
emissions_rate: 1.0466845746410591e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.1854683791827827
gpu_energy: 0
ram_energy: 1.928344048671428
energy_consumed: 4.113812427854221
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 185122.32229161265 |
| Emissions (Co2eq in kg) | 0.1937646791643616 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.1854683791827827 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 1.928344048671428 |
| Consumed energy (kWh) | 4.113812427854221 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3563604704113544 |
| Emissions (Co2eq in kg) | 0.07250624289754828 |
## Note
15 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs64_lr6 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-06 |
| batch_size | 64 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 10258 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 6.242385 | 5.396468 |
| 0.5 | 3.202372 | 3.054127 |
| 1.0 | 3.043711 | 2.978465 |
| 1.5 | 2.981431 | 2.949445 |
| 2.0 | 2.950075 | 2.917226 |
| 2.5 | 2.928359 | 2.893412 |
| 3.0 | 2.904799 | 2.861998 |
| 3.5 | 2.887544 | 2.854341 |
| 4.0 | 2.870782 | 2.847506 |
| 4.5 | 2.865183 | 2.833677 |
| 5.0 | 2.842693 | 2.830147 |
| 5.5 | 2.847798 | 2.820412 |
| 6.0 | 2.843068 | 2.820083 |
|