File size: 3,475 Bytes
be347c3 24eb7a5 1c2ef42 be347c3 24eb7a5 be347c3 24eb7a5 1c2ef42 24eb7a5 1c2ef42 24eb7a5 1c2ef42 be347c3 24eb7a5 be347c3 24eb7a5 1c2ef42 be347c3 24eb7a5 be347c3 24eb7a5 be347c3 24eb7a5 be347c3 24eb7a5 be347c3 24eb7a5 be347c3 24eb7a5 aeecb3c f15ba24 459d0d6 c0ae5bb df23fb5 c831e5a f792436 b59e6d2 0f53517 9fc71cb 5ee7855 87addef ab35477 1a635a5 dbe031c 0cc2407 44451e4 7a83181 4dbc0e6 60e8d44 ff723e0 21f9d7e 063a0fc 3e50707 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 |
---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-04T02:09:36'
project_name: BERTrand_bs64_lr6_emissions_tracker
run_id: 698197ff-1c20-4368-8dfb-1a85fe843c4d
duration: 210196.29861307144
emissions: 0.2715737813178914
emissions_rate: 1.2920007778909722e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 56.25
cpu_energy: 2.4814802918722147
gpu_energy: 0
ram_energy: 3.284294985041019
energy_consumed: 5.765775276913259
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 150
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 210196.29861307144 |
| Emissions (Co2eq in kg) | 0.2715737813178914 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 56.25 |
| CPU energy (kWh) | 2.4814802918722147 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 3.284294985041019 |
| Consumed energy (kWh) | 5.765775276913259 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.4046278748301625 |
| Emissions (Co2eq in kg) | 0.08232688362345299 |
## Note
30 April 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | BERTrand_bs64_lr6 |
| sequence_length | 400 |
| num_epoch | 12 |
| learning_rate | 5e-06 |
| batch_size | 64 |
| weight_decay | 0.0 |
| warm_up_prop | 0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 3147 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.574399 | 15.096123 |
| 0.5 | 9.594637 | 8.148669 |
| 1.0 | 7.853338 | 8.074202 |
| 1.5 | 7.905947 | 7.939530 |
| 2.0 | 7.834033 | 7.833388 |
| 2.5 | 7.720610 | 7.871610 |
| 3.0 | 7.495963 | 7.976839 |
| 3.5 | 7.330389 | 7.752517 |
| 4.0 | 7.214343 | 7.848690 |
| 4.5 | 7.346055 | 7.724831 |
| 5.0 | 7.110836 | 7.715771 |
| 5.5 | 7.125741 | 7.595748 |
| 6.0 | 7.127250 | 7.659738 |
| 6.5 | 7.239036 | 7.671448 |
| 7.0 | 7.073343 | 7.705375 |
| 7.5 | 7.070813 | 7.589307 |
| 8.0 | 7.124647 | 7.582091 |
| 8.5 | 7.166616 | 7.539913 |
| 9.0 | 7.092505 | 7.611073 |
| 9.5 | 7.048057 | 7.625665 |
| 10.0 | 7.101367 | 7.564788 |
| 10.5 | 7.108332 | 7.602001 |
| 11.0 | 7.179604 | 7.554187 |
| 11.5 | 7.028062 | 7.575663 |
| 12.0 | 7.086092 | 7.574604 |
|