Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,7 @@
|
|
| 3 |
Lb_GottBERT is a BERT-like language model for the Luxembourgish language.
|
| 4 |
|
| 5 |
We used the weights of the German GottBERT language model as a starting point and continued pre-training it on the MLM task using the same corpus that we used for our LuxemBERT model (https://huggingface.co/lothritz/LuxemBERT).
|
|
|
|
| 6 |
We achieved higher performances on several downstream tasks than the original LuxemBERT, DA BERT (https://huggingface.co/iolariu/DA_BERT), and its "sister" model Lb_mBERT (https://huggingface.co/lothritz/Lb_mBERT).
|
| 7 |
|
| 8 |
If you would like to know more about our work, the pre-training corpus, or use our models or datasets, please check out /cite the following papers:
|
|
|
|
| 3 |
Lb_GottBERT is a BERT-like language model for the Luxembourgish language.
|
| 4 |
|
| 5 |
We used the weights of the German GottBERT language model as a starting point and continued pre-training it on the MLM task using the same corpus that we used for our LuxemBERT model (https://huggingface.co/lothritz/LuxemBERT).
|
| 6 |
+
|
| 7 |
We achieved higher performances on several downstream tasks than the original LuxemBERT, DA BERT (https://huggingface.co/iolariu/DA_BERT), and its "sister" model Lb_mBERT (https://huggingface.co/lothritz/Lb_mBERT).
|
| 8 |
|
| 9 |
If you would like to know more about our work, the pre-training corpus, or use our models or datasets, please check out /cite the following papers:
|