autoevaluator HF staff commited on
Commit
1e2021a
·
1 Parent(s): 17c347a

Add evaluation results on the plain_text config and test split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and test split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by

@pszemraj
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-launch__gov_report-plain_text-45e121-1564955706).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -82,6 +82,39 @@ model-index:
82
  type: gen_len
83
  value: 268.4032
84
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
85
  ---
86
 
87
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15
 
82
  type: gen_len
83
  value: 268.4032
84
  verified: true
85
+ - task:
86
+ type: summarization
87
+ name: Summarization
88
+ dataset:
89
+ name: launch/gov_report
90
+ type: launch/gov_report
91
+ config: plain_text
92
+ split: test
93
+ metrics:
94
+ - name: ROUGE-1
95
+ type: rouge
96
+ value: 37.0412
97
+ verified: true
98
+ - name: ROUGE-2
99
+ type: rouge
100
+ value: 8.519
101
+ verified: true
102
+ - name: ROUGE-L
103
+ type: rouge
104
+ value: 17.8685
105
+ verified: true
106
+ - name: ROUGE-LSUM
107
+ type: rouge
108
+ value: 33.5036
109
+ verified: true
110
+ - name: loss
111
+ type: loss
112
+ value: 3.628979444503784
113
+ verified: true
114
+ - name: gen_len
115
+ type: gen_len
116
+ value: 219.3885
117
+ verified: true
118
  ---
119
 
120
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15