Update README.md
Browse files
README.md
CHANGED
@@ -66,4 +66,48 @@ DaCy also contains guides on usage of the package as well as behavioural test fo
|
|
66 |
| `ENTS_P` | 84.04 |
|
67 |
| `ENTS_R` | 81.63 |
|
68 |
| `TRANSFORMER_LOSS` | 36527.66 |
|
69 |
-
| `NER_LOSS` | 107413.31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
66 |
| `ENTS_P` | 84.04 |
|
67 |
| `ENTS_R` | 81.63 |
|
68 |
| `TRANSFORMER_LOSS` | 36527.66 |
|
69 |
+
| `NER_LOSS` | 107413.31 |
|
70 |
+
|
71 |
+
|
72 |
+
### Performance tables
|
73 |
+
|
74 |
+
The table below shows the F1, recall and precision of the three DaCy fine-grained models.
|
75 |
+
| Score | DaCy large | DaCy medium | DaCy small |
|
76 |
+
|:---:|:---:|:---:|:---:|
|
77 |
+
| F1 | 0.823 | 0.806 | 0.776 |
|
78 |
+
| Recall | 0.834 | 0.818 | 0.77 |
|
79 |
+
| Precision | 0.813 | 0.794 | 0.781 |
|
80 |
+
|
81 |
+
The table below shows the F1 of the three DaCy fine-grained models within each named entity type.
|
82 |
+
| Named-entity type | DaCy large | DaCy medium | DaCy small |
|
83 |
+
|:---:|:---:|:---:|:---:|
|
84 |
+
| CARDINAL | 0.874 | 0.781 | 0.887 |
|
85 |
+
| DATE | 0.846 | 0.859 | 0.867 |
|
86 |
+
| EVENT | 0.611 | 0.571 | 0.4 |
|
87 |
+
| FACILITY | 0.545 | 0.533 | 0.468 |
|
88 |
+
| GPE | 0.893 | 0.838 | 0.794 |
|
89 |
+
| LANGUAGE | 0.902 | 0.486 | 0.194 |
|
90 |
+
| LAW | 0.686 | 0.625 | 0.606 |
|
91 |
+
| LOCATION | 0.633 | 0.737 | 0.581 |
|
92 |
+
| MONEY | 0.993 | 1 | 0.947 |
|
93 |
+
| NORP | 0.78 | 0.887 | 0.785 |
|
94 |
+
| ORDINAL | 0.696 | 0.7 | 0.727 |
|
95 |
+
| ORGANIZATION | 0.863 | 0.851 | 0.781 |
|
96 |
+
| PERCENT | 0.923 | 0.96 | 0.96 |
|
97 |
+
| PERSON | 0.871 | 0.872 | 0.833 |
|
98 |
+
| PRODUCT | 0.671 | 0.635 | 0.526 |
|
99 |
+
| QUANTITY | 0.386 | 0.654 | 0.708 |
|
100 |
+
| TIME | 0.643 | 0.571 | 0.71 |
|
101 |
+
| WORK OF ART | 0.494 | 0.639 | 0.488 |
|
102 |
+
|
103 |
+
The table below shows the F1 of the three DaCy fine-grained models within each domain of texts in DANSK.
|
104 |
+
| Domain | DaCy large | DaCy medium | DaCy small |
|
105 |
+
|:---:|:---:|:---:|:---:|
|
106 |
+
| All domains combined | 0.823 | 0.806 | 0.776 |
|
107 |
+
| Conversation | 0.796 | 0.718 | 0.82 |
|
108 |
+
| Dannet | 0.75 | 0.667 | 1 |
|
109 |
+
| Legal | 0.852 | 0.854 | 0.866 |
|
110 |
+
| News | 0.841 | 0.759 | 0.86 |
|
111 |
+
| Social Media | 0.793 | 0.847 | 0.8 |
|
112 |
+
| Web | 0.826 | 0.802 | 0.756 |
|
113 |
+
| Wiki and Books | 0.778 | 0.838 | 0.709 |
|