Model save

README.md

@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model was trained from scratch on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 8.2659
+- Loss: 11.3743
 
 ## Model description
 
@@ -37,8 +37,8 @@ The following hyperparameters were used during training:
 - train_batch_size: 16
 - eval_batch_size: 2
 - seed: 42
-- gradient_accumulation_steps: 32
-- total_train_batch_size: 512
+- gradient_accumulation_steps: 64
+- total_train_batch_size: 1024
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 1
@@ -47,7 +47,7 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 5.2959        | 0.6824 | 1000 | 8.2659          |
+| 9.9277        | 0.7051 | 600  | 11.3743         |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1fea087410d40ce1ad75918de426b3db5d4f6ec0b717a75ea386b6a425a345df
+oid sha256:4ae69b7b117873a4a85c2d23b01e8b58573d9a1c1367bd771f44d2b175399ca6
 size 2247492800

runs/Sep11_21-40-37_ip-10-192-10-80/events.out.tfevents.1726090837.ip-10-192-10-80.3114.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5827bffeb30afa90f859db76a47859e5ea0c46b8e914dcbf90e17dafc20a72ae
-size 41921
+oid sha256:cb4d35cc73ccc0d84fc5d8aae1ee06700e09eda47c53c25bbb1701d07d63b1c2
+size 42275