File size: 3,472 Bytes
41891e6
af6cf4e
 
 
1e2d2ea
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
41891e6
 
af6cf4e
41891e6
af6cf4e
 
1e2d2ea
 
 
af6cf4e
1e2d2ea
 
af6cf4e
1e2d2ea
 
 
 
 
 
 
 
 
41891e6
af6cf4e
41891e6
af6cf4e
 
1e2d2ea
 
41891e6
af6cf4e
41891e6
af6cf4e
41891e6
af6cf4e
41891e6
af6cf4e
 
 
 
 
 
 
 
 
 
 
 
 
 
41891e6
af6cf4e
41891e6
 
 
 
 
 
af6cf4e
 
 
 
ce66606
68f3682
4c1471f
d759656
97c481f
2373049
81eb803
04831d7
5c2418e
64d664f
b2da19e
3539695
e87bb4f
b3b130c
8da40fd
b1f1740
176d015
1707475
e384d10
b8ad249
510e05b
f34c885
9a5fd3a
fb4de26
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-04T02:12:06'
  project_name: BERTrand_bs32_lr6_emissions_tracker
  run_id: 2d785f57-ad51-4c63-9963-f04bc0194e7e
  duration: 211015.4645042419
  emissions: 0.2208665367559387
  emissions_rate: 1.0466841246675493e-06
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 37.5
  cpu_energy: 2.491150588653827
  gpu_energy: 0
  ram_energy: 2.1980606118713815
  energy_consumed: 4.689211200525229
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 4
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 100
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 211015.4645042419  |
| Emissions (Co2eq in kg)  | 0.2208665367559387 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 37.5  |
| CPU energy (kWh)         | 2.491150588653827  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 2.1980606118713815  |
| Consumed energy (kWh)    | 4.689211200525229  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 4  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.40620476917066567  |
| Emissions (Co2eq in kg)  | 0.08264772359749474 |

## Note

30 April 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | BERTrand_bs32_lr6 |
| sequence_length          | 400  |
| num_epoch                | 12  |
| learning_rate            | 5e-06  |
| batch_size               | 32  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 6318 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.603048 | 15.109937 |
| 0.5 | 8.715844 | 8.071290 |
| 1.0 | 7.608879 | 8.114126 |
| 1.5 | 7.407612 | 7.914163 |
| 2.0 | 7.323461 | 7.774658 |
| 2.5 | 7.248362 | 7.696718 |
| 3.0 | 7.101276 | 7.856242 |
| 3.5 | 7.134161 | 7.617901 |
| 4.0 | 7.105548 | 7.837306 |
| 4.5 | 7.221799 | 7.653854 |
| 5.0 | 7.047156 | 7.659136 |
| 5.5 | 7.080983 | 7.554190 |
| 6.0 | 7.083629 | 7.670907 |
| 6.5 | 7.180606 | 7.623875 |
| 7.0 | 7.036574 | 7.571451 |
| 7.5 | 7.037596 | 7.550659 |
| 8.0 | 7.082738 | 7.634689 |
| 8.5 | 7.136363 | 7.576325 |
| 9.0 | 7.046428 | 7.594891 |
| 9.5 | 7.022868 | 7.588534 |
| 10.0 | 7.075124 | 7.532026 |
| 10.5 | 7.078401 | 7.519065 |
| 11.0 | 7.109886 | 7.550544 |
| 11.5 | 7.002302 | 7.586807 |
| 12.0 | 7.054321 | 7.544724 |