File size: 3,108 Bytes
b051476 f76c1ce e7438b6 f76c1ce e7438b6 f76c1ce e7438b6 f76c1ce e7438b6 f76c1ce b051476 f76c1ce b051476 f76c1ce e7438b6 f76c1ce e7438b6 f76c1ce e7438b6 f76c1ce b051476 f76c1ce b051476 f76c1ce e7438b6 b051476 f76c1ce b051476 f76c1ce b051476 f76c1ce b051476 f76c1ce b051476 f76c1ce b051476 f76c1ce 02e10c7 10ea9d6 38c5775 c75beac 50198b6 5807b0b c957b8c 00a38aa fbb9f97 7c98070 79c81bc 792d23f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-17T20:11:22'
project_name: ThunBERT_bs32_lr4_emissions_tracker
run_id: d21ea556-0e90-45bb-b083-e820c3d41c27
duration: 207958.82189035416
emissions: 0.2176670990916175
emissions_rate: 1.0466836516624528e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.455065142138801
gpu_energy: 0
ram_energy: 2.1662188877463286
energy_consumed: 4.621284029885088
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 207958.82189035416 |
| Emissions (Co2eq in kg) | 0.2176670990916175 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.455065142138801 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 2.1662188877463286 |
| Consumed energy (kWh) | 4.621284029885088 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.40032073213893177 |
| Emissions (Co2eq in kg) | 0.08145053857372204 |
## Note
15 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs32_lr4 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0005 |
| batch_size | 32 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 20557 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 6.438970 | 8.578580 |
| 0.5 | 7.817422 | 7.780288 |
| 1.0 | 7.740401 | 7.776956 |
| 1.5 | 7.708930 | 7.715732 |
| 2.0 | 7.687033 | 7.698126 |
| 2.5 | 7.672986 | 7.689110 |
| 3.0 | 7.659054 | 7.694452 |
| 3.5 | 7.656073 | 7.672446 |
| 4.0 | 7.642637 | 7.669732 |
| 4.5 | 7.643010 | 7.676241 |
| 5.0 | 7.632827 | 7.657712 |
| 5.5 | 7.629512 | 7.660105 |
| 6.0 | 7.626969 | 7.654580 |
|