llamantino7b_question_answering_finetuining

README.md

@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [swap-uniba/LLaMAntino-2-7b-hf-ITA](https://huggingface.co/swap-uniba/LLaMAntino-2-7b-hf-ITA) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.3824
+- Loss: 1.4122
 
 ## Model description
 
@@ -50,9 +50,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 1.6494        | 1.0   | 90   | 1.4148          |
-| 1.1929        | 2.0   | 180  | 1.3482          |
-| 0.8231        | 3.0   | 270  | 1.3824          |
+| 1.6512        | 1.0   | 90   | 1.4570          |
+| 1.1883        | 2.0   | 180  | 1.3863          |
+| 0.8381        | 3.0   | 270  | 1.4122          |
 
 
 ### Framework versions

adapter_config.json

@@ -19,8 +19,8 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "q_proj",
-    "v_proj"
+    "v_proj",
+    "q_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_rslora": false

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0ff7a18d877dc389a8a57ea81d8f02ce1fabcd63119126a5f4d2660059f741a3
+oid sha256:993954f9ce4becbddd037c39dc491eec4d1a6ee4902b806353dbb77551c460ca
 size 134235048

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b598e9e0e9d723cb86c7c4d06140b8c296d752476f915059773896b143163f9b
+oid sha256:79dcf18fbeb323b5d98ac12737e836d00054fe2efd3d36492ac88a8e9c0bef19
 size 4411