Hugging Face's logo

projecte-aina
/
longformer-base-4096-ca-v2

Fill-Mask
Transformers
PyTorch
Catalan
longformer
catalan
masked-lm
longformer-base-4096-ca-v2
CaText
Catalan Textual Corpus
Inference Endpoints
Model card Files Community
1
angel-poc commited on
Commit
8bbbcf4
·
1 Parent(s): 76064d4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -158,14 +158,14 @@ After fine-tuning the model on the downstream tasks, it achieved the following p
158
 
159
  ### Evaluation results
160
 
161
- | Task | NER (F1) | POS (F1) | STS-ca (Comb) | TeCla (Acc.) | TEca (Acc.) | VilaQuAD (F1/EM)| ViquiQuAD (F1/EM) | CatalanQA (F1/EM) |
162
- | ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|
163
- | RoBERTa-large-ca-v2 | **89.82** | **99.02** | **83.41** | **75.46** | 83.61 | **89.34/75.50** | **89.20**/75.77 | **90.72/79.06** |
164
- | RoBERTa-base-ca-v2 | 89.29 | 98.96 | 79.07 | 74.26 | 83.14 | 87.74/72.58 | 88.72/**75.91** | 89.50/76.63 |
165
- | Longformer-base-4096-ca | 88.49 | 98.98 | 78.37 | - | **83.89** | 87.59/72.33 | 88.70/**76.05** | 89.33/77.03 |
166
- | BERTa | 89.76 | 98.96 | 80.19 | 73.65 | 79.26 | 85.93/70.58 | 87.12/73.11 | 89.17/77.14 |
167
- | mBERT | 86.87 | 98.83 | 74.26 | 69.90 | 74.63 | 82.78/67.33 | 86.89/73.53 | 86.90/74.19 |
168
- | XLM-RoBERTa | 86.31 | 98.89 | 61.61 | 70.14 | 33.30 | 86.29/71.83 | 86.88/73.11 | 88.17/75.93 |
169
 
170
 
171
 
 
158
 
159
  ### Evaluation results
160
 
161
+ | Task | NER (F1) | POS (F1) | STS-ca (Comb) | TeCla (Acc.) | TEca (Acc.) | VilaQuAD (F1/EM)| ViquiQuAD (F1/EM) | CatalanQA (F1/EM) | XQuAD-ca <sup>1</sup> (F1/EM) |
162
+ | ------------|:-------------:| -----:|:------|:------|:-------|:------|:----|:----|:----|
163
+ | RoBERTa-large-ca-v2 | **89.82** | **99.02** | **83.41** | **75.46** | 83.61 | **89.34/75.50** | **89.20**/75.77 | **90.72/79.06** | **73.79**/55.34 |
164
+ | RoBERTa-base-ca-v2 | 89.29 | 98.96 | 79.07 | 74.26 | 83.14 | 87.74/72.58 | 88.72/**75.91** | 89.50/76.63 | 73.64/**55.42** |
165
+ | Longformer-base-4096-ca | 88.49 | 98.98 | 78.37 | - | **83.89** | 87.59/72.33 | 88.70/**76.05** | 89.33/77.03 | 68.82/50.21 |
166
+ | BERTa | 89.76 | 98.96 | 80.19 | 73.65 | 79.26 | 85.93/70.58 | 87.12/73.11 | 89.17/77.14 | 69.20/51.47 |
167
+ | mBERT | 86.87 | 98.83 | 74.26 | 69.90 | 74.63 | 82.78/67.33 | 86.89/73.53 | 86.90/74.19 | 68.79/50.80 |
168
+ | XLM-RoBERTa | 86.31 | 98.89 | 61.61 | 70.14 | 33.30 | 86.29/71.83 | 86.88/73.11 | 88.17/75.93 | 72.55/54.16 |
169
 
170
 
171