Commit
·
95f02c9
1
Parent(s):
ebee3be
Update README.md
Browse files
README.md
CHANGED
@@ -32,10 +32,10 @@ This medical named entity recognition model detects 7 types of semantic groups f
|
|
32 |
- PROC: diagnostic and therapeutic procedures, laboratory analyses and medical research activities (e.g. *cirugía*, 'surgery')
|
33 |
|
34 |
The model achieves the following results on the test set (when trained with the training and development set; results are averaged over 5 evaluation rounds):
|
35 |
-
- Precision: 0.
|
36 |
-
- Recall: 0.
|
37 |
-
- F1: 0.
|
38 |
-
- Accuracy: 0.
|
39 |
|
40 |
|
41 |
## Model description
|
@@ -98,27 +98,27 @@ The following hyperparameters were used during training:
|
|
98 |
- seed: we used different seeds for 5 evaluation rounds, and uploaded the model with the best results
|
99 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
100 |
- lr_scheduler_type: linear
|
101 |
-
- num_epochs:
|
102 |
|
103 |
|
104 |
### Training results (test set; average and standard deviation of 5 rounds with different seeds)
|
105 |
|
106 |
| Precision | Recall | F1 | Accuracy |
|
107 |
|:--------------:|:--------------:|:--------------:|:--------------:|
|
108 |
-
| 0.
|
109 |
|
110 |
|
111 |
**Results per class (test set; average and standard deviation of 5 rounds with different seeds)**
|
112 |
|
113 |
| Class | Precision | Recall | F1 | Support |
|
114 |
|:----------:|:--------------:|:--------------:|:--------------:|:---------:|
|
115 |
-
| ANAT | 0.
|
116 |
-
| CHEM | 0.
|
117 |
-
| DEVI | 0.
|
118 |
-
| DISO | 0.
|
119 |
-
| LIVB | 0.
|
120 |
-
| PHYS | 0.
|
121 |
-
| PROC | 0.
|
122 |
|
123 |
|
124 |
### Framework versions
|
|
|
32 |
- PROC: diagnostic and therapeutic procedures, laboratory analyses and medical research activities (e.g. *cirugía*, 'surgery')
|
33 |
|
34 |
The model achieves the following results on the test set (when trained with the training and development set; results are averaged over 5 evaluation rounds):
|
35 |
+
- Precision: 0.878 (±0.003)
|
36 |
+
- Recall: 0.894 (±0.003)
|
37 |
+
- F1: 0.886 (±0.002)
|
38 |
+
- Accuracy: 0.961 (±0.001)
|
39 |
|
40 |
|
41 |
## Model description
|
|
|
98 |
- seed: we used different seeds for 5 evaluation rounds, and uploaded the model with the best results
|
99 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
100 |
- lr_scheduler_type: linear
|
101 |
+
- num_epochs: average 17 epochs (±2.83); trained with early stopping if no improvement after 5 epochs (early stopping patience: 5)
|
102 |
|
103 |
|
104 |
### Training results (test set; average and standard deviation of 5 rounds with different seeds)
|
105 |
|
106 |
| Precision | Recall | F1 | Accuracy |
|
107 |
|:--------------:|:--------------:|:--------------:|:--------------:|
|
108 |
+
| 0.878 (±0.003) | 0.894 (±0.003) | 0.886 (±0.002) | 0.961 (±0.001) |
|
109 |
|
110 |
|
111 |
**Results per class (test set; average and standard deviation of 5 rounds with different seeds)**
|
112 |
|
113 |
| Class | Precision | Recall | F1 | Support |
|
114 |
|:----------:|:--------------:|:--------------:|:--------------:|:---------:|
|
115 |
+
| ANAT | 0.728 (±0.030) | 0.686 (±0.030) | 0.706 (±0.025) | 308 |
|
116 |
+
| CHEM | 0.917 (±0.005) | 0.923 (±0.008) | 0.920 (±0.005) | 2932 |
|
117 |
+
| DEVI | 0.645 (±0.018) | 0.791 (±0.047) | 0.711 (±0.027) | 134 |
|
118 |
+
| DISO | 0.890 (±0.008) | 0.903 (±0.003) | 0.896 (±0.003) | 3065 |
|
119 |
+
| LIVB | 0.949 (±0.004) | 0.959 (±0.006) | 0.954 (±0.003) | 1685 |
|
120 |
+
| PHYS | 0.766 (±0.021) | 0.765 (±0.012) | 0.765 (±0.008) | 308 |
|
121 |
+
| PROC | 0.842 (±0.002) | 0.871 (±0.004) | 0.856 (±0.001) | 4154 |
|
122 |
|
123 |
|
124 |
### Framework versions
|