Add evaluation results on the plain_text config and test split of launch/gov_report

#4
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -82,6 +82,39 @@ model-index:
82
  type: gen_len
83
  value: 268.4032
84
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
85
  ---
86
 
87
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15
 
82
  type: gen_len
83
  value: 268.4032
84
  verified: true
85
+ - task:
86
+ type: summarization
87
+ name: Summarization
88
+ dataset:
89
+ name: launch/gov_report
90
+ type: launch/gov_report
91
+ config: plain_text
92
+ split: test
93
+ metrics:
94
+ - name: ROUGE-1
95
+ type: rouge
96
+ value: 37.0412
97
+ verified: true
98
+ - name: ROUGE-2
99
+ type: rouge
100
+ value: 8.519
101
+ verified: true
102
+ - name: ROUGE-L
103
+ type: rouge
104
+ value: 17.8685
105
+ verified: true
106
+ - name: ROUGE-LSUM
107
+ type: rouge
108
+ value: 33.5036
109
+ verified: true
110
+ - name: loss
111
+ type: loss
112
+ value: 3.628979444503784
113
+ verified: true
114
+ - name: gen_len
115
+ type: gen_len
116
+ value: 219.3885
117
+ verified: true
118
  ---
119
 
120
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP15