File size: 3,473 Bytes
523f390
c3013bc
 
 
46f7f4d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
523f390
 
c3013bc
523f390
c3013bc
 
46f7f4d
 
 
c3013bc
46f7f4d
 
c3013bc
46f7f4d
 
 
 
 
 
 
 
 
523f390
c3013bc
523f390
c3013bc
 
46f7f4d
 
523f390
c3013bc
523f390
c3013bc
523f390
c3013bc
523f390
c3013bc
 
 
 
 
 
 
 
 
 
 
 
 
 
523f390
c3013bc
523f390
 
 
 
 
 
c3013bc
 
 
 
81cc926
aa15517
9e7a8b5
19bb993
99646b2
3d0aaa8
a8981f1
bbe27d3
645b47f
46cd883
afe4759
0ab70aa
b99e58c
9270247
3955e45
7bef177
29e2081
6f10f56
35c2766
adea068
f25d5f0
6673e30
8cf6b47
9c84a35
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-03T23:03:49'
  project_name: BERTrand_bs16_lr6_emissions_tracker
  run_id: c4c202f3-d5d4-403c-b72f-93edc13d2220
  duration: 199222.14457845688
  emissions: 0.2085228370280885
  emissions_rate: 1.046685033279365e-06
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 37.5
  cpu_energy: 2.3519248156185015
  gpu_energy: 0
  ram_energy: 2.075217644798255
  energy_consumed: 4.427142460416734
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 4
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 100
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 199222.14457845688  |
| Emissions (Co2eq in kg)  | 0.2085228370280885 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 37.5  |
| CPU energy (kWh)         | 2.3519248156185015  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 2.075217644798255  |
| Consumed energy (kWh)    | 4.427142460416734  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 4  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.3835026283135295  |
| Emissions (Co2eq in kg)  | 0.07802867329322895 |

## Note

30 April 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | BERTrand_bs16_lr6 |
| sequence_length          | 400  |
| num_epoch                | 12  |
| learning_rate            | 5e-06  |
| batch_size               | 16  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 12597 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.499363 | 15.126202 |
| 0.5 | 8.243008 | 8.091313 |
| 1.0 | 7.354550 | 7.973097 |
| 1.5 | 7.244512 | 7.687902 |
| 2.0 | 7.199471 | 7.686438 |
| 2.5 | 7.161911 | 7.657964 |
| 3.0 | 7.049606 | 7.765894 |
| 3.5 | 7.091233 | 7.786471 |
| 4.0 | 7.060327 | 7.814007 |
| 4.5 | 7.164975 | 7.602441 |
| 5.0 | 7.008690 | 7.586652 |
| 5.5 | 7.035732 | 7.525334 |
| 6.0 | 7.045719 | 7.715493 |
| 6.5 | 7.108394 | 7.486681 |
| 7.0 | 6.992529 | 7.641908 |
| 7.5 | 6.993111 | 7.575982 |
| 8.0 | 7.051304 | 7.670884 |
| 8.5 | 7.075128 | 7.527084 |
| 9.0 | 7.010871 | 7.556140 |
| 9.5 | 6.978617 | 7.623441 |
| 10.0 | 7.033166 | 7.562979 |
| 10.5 | 7.026733 | 7.549661 |
| 11.0 | 7.080350 | 7.510597 |
| 11.5 | 6.955319 | 7.589880 |
| 12.0 | 7.023086 | 7.495114 |