DrishtiSharma
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
17 |
This model is a fine-tuned version of [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) on the None dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
- Loss: 1.0769
|
20 |
-
- Rouge Scores: {'rouge1':
|
21 |
- Bleu Scores: [0.0002881182166187815, 0.0002842750061873772, 0.0002764768847375588, 0.00026750640347869873]
|
22 |
- Gen Len: 2048.0
|
23 |
|
@@ -53,8 +53,8 @@ The following hyperparameters were used during training:
|
|
53 |
|
54 |
| Training Loss | Epoch | Step | Validation Loss | Rouge Scores | Bleu Scores | Gen Len |
|
55 |
|:-------------:|:-----:|:----:|:---------------:|:-----------------------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------:|:--------:|
|
56 |
-
| 1.1771 | 1.0 | 500 | 1.0579 | {'rouge1':
|
57 |
-
| 0.7788 | 2.0 | 1000 | 1.0769 | {'rouge1': 90.45408202972536, 'rouge2':
|
58 |
|
59 |
|
60 |
### Framework versions
|
|
|
17 |
This model is a fine-tuned version of [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) on the None dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
- Loss: 1.0769
|
20 |
+
- Rouge Scores: {'rouge1': 0.9045408202972536, 'rouge2': 0.795425441228359, 'rougeL': 0.8399846297860634, 'rougeLsum': 0.9043739034131012}
|
21 |
- Bleu Scores: [0.0002881182166187815, 0.0002842750061873772, 0.0002764768847375588, 0.00026750640347869873]
|
22 |
- Gen Len: 2048.0
|
23 |
|
|
|
53 |
|
54 |
| Training Loss | Epoch | Step | Validation Loss | Rouge Scores | Bleu Scores | Gen Len |
|
55 |
|:-------------:|:-----:|:----:|:---------------:|:-----------------------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------:|:--------:|
|
56 |
+
| 1.1771 | 1.0 | 500 | 1.0579 | {'rouge1': 0.9070255400902434, 'rouge2': 0.7976770190068221, 'rougeL': 0.8400261479965636, 'rougeLsum': 0.9069363147075731} | [0.00028395954091190866, 0.0002796973368739713, 0.0002722057765709132, 0.000263740024418467] | 2047.996 |
|
57 |
+
| 0.7788 | 2.0 | 1000 | 1.0769 | {'rouge1': 0.90.45408202972536, 'rouge2': 0.795425441228359, 'rougeL': 0.8399846297860634, 'rougeLsum': 0.9043739034131012} | [0.0002881182166187815, 0.0002842750061873772, 0.0002764768847375588, 0.00026750640347869873] | 2048.0 |
|
58 |
|
59 |
|
60 |
### Framework versions
|