model update
Browse files
README.md
CHANGED
@@ -42,6 +42,12 @@ model-index:
|
|
42 |
- name: MoverScore
|
43 |
type: moverscore
|
44 |
value: 0.622602267900722
|
|
|
|
|
|
|
|
|
|
|
|
|
45 |
---
|
46 |
|
47 |
# Model Card of `lmqg/t5-base-tweetqa-qag-np`
|
@@ -108,6 +114,13 @@ question = pipe(' Beyonce further expanded her acting career, starring as blues
|
|
108 |
| [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.134 | 0.372 | 0.311 | 0.908 | 0.623 | [link](https://huggingface.co/lmqg/t5-base-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
|
109 |
|
110 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
111 |
|
112 |
|
113 |
## Training hyperparameters
|
|
|
42 |
- name: MoverScore
|
43 |
type: moverscore
|
44 |
value: 0.622602267900722
|
45 |
+
- name: QAAlignedF1Score (BERTScore)
|
46 |
+
type: qa_aligned_f1_score_bertscore
|
47 |
+
value: 0.9239486200615753
|
48 |
+
- name: QAAlignedF1Score (MoverScore)
|
49 |
+
type: qa_aligned_f1_score_moverscore
|
50 |
+
value: 0.6482953232883135
|
51 |
---
|
52 |
|
53 |
# Model Card of `lmqg/t5-base-tweetqa-qag-np`
|
|
|
114 |
| [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.134 | 0.372 | 0.311 | 0.908 | 0.623 | [link](https://huggingface.co/lmqg/t5-base-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
|
115 |
|
116 |
|
117 |
+
### Metrics (QAG)
|
118 |
+
|
119 |
+
| Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
|
120 |
+
|:--------|:-----|--------------------------------:|---------------------------------:|-----:|
|
121 |
+
| [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.924 | 0.648 | [link](https://huggingface.co/lmqg/t5-base-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
|
122 |
+
|
123 |
+
|
124 |
|
125 |
|
126 |
## Training hyperparameters
|