Philip May
commited on
Commit
·
dd54448
1
Parent(s):
4b6bddc
Update README.md
Browse files
README.md
CHANGED
@@ -72,14 +72,14 @@ This model is trained on the following datasets:
|
|
72 |
| [ml6team/mt5-small-german-finetune-mlsum](https://huggingface.co/ml6team/mt5-small-german-finetune-mlsum) | no beam | 18.3607 | 5.3604 | 14.5456 | 16.1946
|
73 |
| [ml6team/mt5-small-german-finetune-mlsum](https://huggingface.co/ml6team/mt5-small-german-finetune-mlsum) | num_beams: 5 | 19.6166 | 5.8818 | 14.74 | 16.889
|
74 |
|
75 |
-
## Evaluation on CNN Daily English Test Set
|
76 |
-
|
77 |
-
| Model |
|
78 |
-
|
79 |
-
| mT5-small-sum-de-en-01 (this) |
|
80 |
-
| [mrm8488/t5-base-finetuned-summarize-news](https://huggingface.co/mrm8488/t5-base-finetuned-summarize-news) |
|
81 |
-
| [facebook/bart-large-xsum](https://huggingface.co/facebook/bart-large-xsum) |
|
82 |
-
| [sshleifer/distilbart-xsum-12-6](https://huggingface.co/sshleifer/distilbart-xsum-12-6) |
|
83 |
|
84 |
## License
|
85 |
|
|
|
72 |
| [ml6team/mt5-small-german-finetune-mlsum](https://huggingface.co/ml6team/mt5-small-german-finetune-mlsum) | no beam | 18.3607 | 5.3604 | 14.5456 | 16.1946
|
73 |
| [ml6team/mt5-small-german-finetune-mlsum](https://huggingface.co/ml6team/mt5-small-german-finetune-mlsum) | num_beams: 5 | 19.6166 | 5.8818 | 14.74 | 16.889
|
74 |
|
75 |
+
## Evaluation on CNN Daily English Test Set (no beams)
|
76 |
+
|
77 |
+
| Model | rouge1 | rouge2 | rougeL | rougeLsum
|
78 |
+
|-------|--------|--------|--------|----------
|
79 |
+
| mT5-small-sum-de-en-01 (this) | 37.6339 | 16.5317 | 27.1418 | 34.9951
|
80 |
+
| [mrm8488/t5-base-finetuned-summarize-news](https://huggingface.co/mrm8488/t5-base-finetuned-summarize-news) | 37.576 | 14.7389 | 24.0254 | 34.4634
|
81 |
+
| [facebook/bart-large-xsum](https://huggingface.co/facebook/bart-large-xsum) | 28.5374 | 9.8565 | 19.4829 | 24.7364
|
82 |
+
| [sshleifer/distilbart-xsum-12-6](https://huggingface.co/sshleifer/distilbart-xsum-12-6) | 26.7664 | 8.8243 | 18.3703 | 23.2614
|
83 |
|
84 |
## License
|
85 |
|