Model save

README.md

@@ -1,6 +1,4 @@
 ---
-language:
-- id
 license: apache-2.0
 base_model: LazarusNLP/IndoNanoT5-base
 tags:
@@ -19,11 +17,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [LazarusNLP/IndoNanoT5-base](https://huggingface.co/LazarusNLP/IndoNanoT5-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.5917
-- Rouge1: 0.3832
+- Loss: 0.5212
+- Rouge1: 0.6659
 - Rouge2: 0.0
-- Rougel: 0.3816
-- Rougelsum: 0.3824
+- Rougel: 0.6648
+- Rougelsum: 0.6661
 - Gen Len: 1.0
 
 ## Model description
@@ -43,8 +41,8 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-05
-- train_batch_size: 8
+- learning_rate: 0.001
+- train_batch_size: 16
 - eval_batch_size: 32
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
@@ -55,16 +53,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
 |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
-| 1.2253        | 1.0   | 1784 | 0.6577          | 0.4006 | 0.0    | 0.3969 | 0.4007    | 1.0     |
-| 0.7893        | 2.0   | 3568 | 0.6133          | 0.4188 | 0.0    | 0.4167 | 0.4194    | 1.0     |
-| 0.7351        | 3.0   | 5352 | 0.6062          | 0.3925 | 0.0    | 0.3898 | 0.3908    | 1.0     |
-| 0.7092        | 4.0   | 7136 | 0.5990          | 0.3834 | 0.0    | 0.381  | 0.3826    | 1.0     |
-| 0.6978        | 5.0   | 8920 | 0.5917          | 0.3832 | 0.0    | 0.3816 | 0.3824    | 1.0     |
+| 0.8224        | 1.0   | 892  | 0.5704          | 0.6572 | 0.0    | 0.6564 | 0.655     | 1.0     |
+| 0.6196        | 2.0   | 1784 | 0.5431          | 0.6602 | 0.0    | 0.6579 | 0.6606    | 1.0     |
+| 0.5778        | 3.0   | 2676 | 0.5373          | 0.6757 | 0.0    | 0.6756 | 0.6745    | 1.0     |
+| 0.5503        | 4.0   | 3568 | 0.5256          | 0.659  | 0.0    | 0.6569 | 0.6586    | 1.0     |
+| 0.5343        | 5.0   | 4460 | 0.5212          | 0.6659 | 0.0    | 0.6648 | 0.6661    | 1.0     |
 
 
 ### Framework versions
 
 - Transformers 4.40.2
-- Pytorch 2.3.0+cu121
-- Datasets 2.19.1
+- Pytorch 2.3.1+cu121
+- Datasets 2.20.0
 - Tokenizers 0.19.1

adapter-summarization/adapter_config.json

@@ -12,11 +12,11 @@
     "intermediate_lora": false,
     "leave_out": [],
     "output_lora": false,
-    "r": 16,
+    "r": 8,
     "selfattn_lora": true,
     "use_gating": false
   },
-  "config_id": "141b248112091265",
+  "config_id": "625403edad0bf919",
   "hidden_size": 768,
   "model_class": "T5ForConditionalGeneration",
   "model_name": "LazarusNLP/IndoNanoT5-base",

adapter-summarization/pytorch_adapter.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:17acf4245cdcf518875c3303529cd8b5c0b3942a274ceb923e4f9b50ad65788e
-size 7131954
+oid sha256:c691aedf978ac1ae4e1d2172c5c846f2ebdd845a690176236a336f1b3d589b5f
+size 3593010