File size: 3,105 Bytes
356328d 03b33c4 b0435e2 03b33c4 b0435e2 03b33c4 b0435e2 03b33c4 b0435e2 03b33c4 356328d 03b33c4 356328d 03b33c4 b0435e2 03b33c4 b0435e2 03b33c4 b0435e2 03b33c4 356328d 03b33c4 356328d 03b33c4 b0435e2 356328d 03b33c4 356328d 03b33c4 356328d 03b33c4 356328d 03b33c4 356328d 03b33c4 356328d 03b33c4 a715ef0 5a14761 3f54d61 93f0c5e f6da14e 0e7432f a553adf 4a03550 ba9a34c c922135 b0439a0 a8c1d2b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-17T12:33:24'
project_name: ThunBERT_bs32_lr6_emissions_tracker
run_id: 0e370511-86b8-4ed9-a6b0-d95eceb9448b
duration: 180383.6925137043
emissions: 0.1888047561130275
emissions_rate: 1.0466841735079988e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.1295260795647915
gpu_energy: 0
ram_energy: 1.878982362146172
energy_consumed: 4.008508441710953
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 180383.6925137043 |
| Emissions (Co2eq in kg) | 0.1888047561130275 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.1295260795647915 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 1.878982362146172 |
| Consumed energy (kWh) | 4.008508441710953 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.34723860808888074 |
| Emissions (Co2eq in kg) | 0.07065027956786751 |
## Note
15 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs32_lr6 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-06 |
| batch_size | 32 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 20427 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 6.533427 | 5.411902 |
| 0.5 | 3.138879 | 3.017244 |
| 1.0 | 2.992936 | 2.933242 |
| 1.5 | 2.941352 | 2.887388 |
| 2.0 | 2.903994 | 2.857268 |
| 2.5 | 2.873236 | 2.842794 |
| 3.0 | 2.853003 | 2.823149 |
| 3.5 | 2.836404 | 2.804283 |
| 4.0 | 2.823654 | 2.797022 |
| 4.5 | 2.808353 | 2.784016 |
| 5.0 | 2.792922 | 2.781907 |
| 5.5 | 2.785201 | 2.784908 |
| 6.0 | 2.782254 | 2.771417 |
|