yeshpanovrustem
commited on
Commit
·
cfe11f6
1
Parent(s):
05f13d5
Update README.md
Browse files
README.md
CHANGED
@@ -24,14 +24,17 @@ widget:
|
|
24 |
datasets:
|
25 |
- yeshpanovrustem/kaznerd_cleaned
|
26 |
---
|
|
|
27 |
# A Named Entity Recognition Model for Kazakh
|
28 |
- The model was inspired by the [LREC 2022](https://lrec2022.lrec-conf.org/en/) paper [*KazNERD: Kazakh Named Entity Recognition Dataset*](https://aclanthology.org/2022.lrec-1.44).
|
29 |
- The original repository for the paper can be found at *https://github.com/IS2AI/KazNERD*.
|
|
|
30 |
## Evaluation results on the validation and test sets
|
31 |
| | Validation set | | | Test set| |
|
32 |
|:---:| :---: | :---: | :---: | :---: | :---: |
|
33 |
| **Precision** | **Recall** | **F<sub>1</sub>-score** | **Precision** | **Recall** | **F<sub>1</sub>-score** |
|
34 |
| 96.58% | 96.66% | 96.62% | 96.49% | 96.86% | 96.67% |
|
|
|
35 |
## Model performance for the NE classes of the validation set
|
36 |
| NE Class | Precision | Recall | F<sub>1</sub>-score | Support |
|
37 |
| :---: | :---: | :---: | :---: | :---: |
|
@@ -62,4 +65,36 @@ datasets:
|
|
62 |
| **TIME** | 94.81% | 96.63% | 95.71% | 208 |
|
63 |
| **micro avg** | **96.58%** | **96.66%** | **96.62%** | **13,189** |
|
64 |
| **macro avg** | **90.12%** | **87.51%** | **88.39%** | **13,189** |
|
65 |
-
| **weighted avg** | **96.67%** | **96.66%** | **96.63%** | **13,189** |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
datasets:
|
25 |
- yeshpanovrustem/kaznerd_cleaned
|
26 |
---
|
27 |
+
|
28 |
# A Named Entity Recognition Model for Kazakh
|
29 |
- The model was inspired by the [LREC 2022](https://lrec2022.lrec-conf.org/en/) paper [*KazNERD: Kazakh Named Entity Recognition Dataset*](https://aclanthology.org/2022.lrec-1.44).
|
30 |
- The original repository for the paper can be found at *https://github.com/IS2AI/KazNERD*.
|
31 |
+
-
|
32 |
## Evaluation results on the validation and test sets
|
33 |
| | Validation set | | | Test set| |
|
34 |
|:---:| :---: | :---: | :---: | :---: | :---: |
|
35 |
| **Precision** | **Recall** | **F<sub>1</sub>-score** | **Precision** | **Recall** | **F<sub>1</sub>-score** |
|
36 |
| 96.58% | 96.66% | 96.62% | 96.49% | 96.86% | 96.67% |
|
37 |
+
|
38 |
## Model performance for the NE classes of the validation set
|
39 |
| NE Class | Precision | Recall | F<sub>1</sub>-score | Support |
|
40 |
| :---: | :---: | :---: | :---: | :---: |
|
|
|
65 |
| **TIME** | 94.81% | 96.63% | 95.71% | 208 |
|
66 |
| **micro avg** | **96.58%** | **96.66%** | **96.62%** | **13,189** |
|
67 |
| **macro avg** | **90.12%** | **87.51%** | **88.39%** | **13,189** |
|
68 |
+
| **weighted avg** | **96.67%** | **96.66%** | **96.63%** | **13,189** |
|
69 |
+
|
70 |
+
## Model performance for the NE classes of the test set
|
71 |
+
| NE Class | Precision | Recall | F<sub>1</sub>-score | Support |
|
72 |
+
| :---: | :---: | :---: | :---: | :---: |
|
73 |
+
| **ADAGE** | 71.43% | 29.41% | 41.67% | 17 |
|
74 |
+
| **ART** | 95.71% | 96.89% | 96.30% | 161 |
|
75 |
+
| **CARDINAL** | 98.43% | 98.60% | 98.51% | 2,789 |
|
76 |
+
| **CONTACT** | 94.44% | 85.00% | 89.47% | 20 |
|
77 |
+
| **DATE** | 96.59% | 97.60% | 97.09% | 2,584 |
|
78 |
+
| **DISEASE** | 87.69% | 95.80% | 91.57% | 119 |
|
79 |
+
| **EVENT** | 86.67% | 92.86% | 89.66% | 154 |
|
80 |
+
| **FACILITY** | 74.88% | 81.73% | 78.16% | 197 |
|
81 |
+
| **GPE** | 98.57% | 97.81% | 98.19% | 1,691 |
|
82 |
+
| **LANGUAGE** | 90.70% | 95.12% | 92.86% | 41 |
|
83 |
+
| **LAW** | 93.33% | 76.36% | 84.00% | 55 |
|
84 |
+
| **LOCATION** | 92.08% | 89.42% | 90.73% | 208 |
|
85 |
+
| **MISCELLANEOUS** | 86.21% | 96.15% | 90.91% | 26 |
|
86 |
+
| **MONEY** | 100.00% | 100.00% | 100.00% | 427 |
|
87 |
+
| **NON_HUMAN** | 0.00% | 0.00% | 0.00% | 1 |
|
88 |
+
| **NORP** | 99.46% | 99.18% | 99.32% | 368 |
|
89 |
+
| **ORDINAL** | 96.63% | 97.64% | 97.14% | 382 |
|
90 |
+
| **ORGANISATION** | 90.97% | 91.23% | 91.10% | 718 |
|
91 |
+
| **PERCENTAGE** | 98.05% | 98.05% | 98.05% | 462 |
|
92 |
+
| **PERSON** | 98.70% | 99.13% | 98.92% | 1,151 |
|
93 |
+
| **POSITION** | 96.36% | 97.65% | 97.00% | 597 |
|
94 |
+
| **PRODUCT** | 89.23% | 77.33% | 82.86% | 75 |
|
95 |
+
| **PROJECT** | 93.69% | 93.69% | 93.69% | 206 |
|
96 |
+
| **QUANTITY** | 97.26% | 97.02% | 97.14% | 403 |
|
97 |
+
| **TIME** | 94.95% | 94.09% | 94.52% | 220 |
|
98 |
+
| **micro avg** | **96.54%** | **96.85%** | **96.69%** | **13,072** |
|
99 |
+
| **macro avg** | **88.88%** | **87.11%** | **87.55%** | **13,072** |
|
100 |
+
| **weighted avg** | **96.55%** | **96.85%** | **96.67%** | **13,072** |
|