huggingartists

README.md

@@ -45,15 +45,15 @@ from datasets import load_dataset
 dataset = load_dataset("huggingartists/eminem")
 ```
 
-[Explore the data](https://wandb.ai/huggingartists/huggingartists/runs/3rukw5ac/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
+[Explore the data](https://wandb.ai/huggingartists/huggingartists/runs/1hflh7u6/artifacts), which is tracked with [W&B artifacts](https://docs.wandb.com/artifacts) at every step of the pipeline.
 
 ## Training procedure
 
 The model is based on a pre-trained [GPT-2](https://huggingface.co/gpt2) which is fine-tuned on Eminem's lyrics.
 
-Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/huggingartists/huggingartists/runs/2mua6tz8) for full transparency and reproducibility.
+Hyperparameters and metrics are recorded in the [W&B training run](https://wandb.ai/huggingartists/huggingartists/runs/4gvmxrna) for full transparency and reproducibility.
 
-At the end of training, [the final model](https://wandb.ai/huggingartists/huggingartists/runs/2mua6tz8/artifacts) is logged and versioned.
+At the end of training, [the final model](https://wandb.ai/huggingartists/huggingartists/runs/4gvmxrna/artifacts) is logged and versioned.
 
 ## How to use
 

evaluation.txt

@@ -1 +1 @@
-{"eval_loss": 0.22213919460773468, "eval_runtime": 29.4043, "eval_samples_per_second": 21.936, "eval_steps_per_second": 2.755, "epoch": 3.0}
+{"eval_loss": 0.17033791542053223, "eval_runtime": 13.3261, "eval_samples_per_second": 45.099, "eval_steps_per_second": 5.703, "epoch": 2.0}

flax_model.msgpack

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f2c3b167b74a63ec8fb077ce24d21025947fef9ecb32878a46ee4d6977cc15f0
+oid sha256:84c1e0b5ec78700742efecda3264cb6c05363dcd0cfd2603f9208a76f99a8e57
 size 497764120

optimizer.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:26834f0e4208938d811a9dfa581c60096828db9664c29122cbe7c108c2266f68
+oid sha256:0dd1f75aa87ace65ff5eabf8bf35c462a5ea435576d30fa3ae79699f3a222ffd
 size 995604017

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c21f7e095359913b7c6cf81d01da61fcc6b0f7f55c7374a09691747e7e324411
+oid sha256:05239515b946d463e5c208905abbc650450660236b44874d528bf2e8ff9404e4
 size 510396521

rng_state.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:091b8c645ee921fc1fb21bf66e87b6404370564c2f1e26f8e92fd9a5afcce570
+oid sha256:2a51ff024d36f5b16e406a7ff85689d3f4ab6243d4b5396f02ca94ed03ed314b
 size 14567

scheduler.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c3e6d52e9eda83b53901112c80d072ee8b7df374009cb1437cc93a39ef8c5f83
+oid sha256:68dcd37ec9f598b778dcfcdd0e6ff8990fdc855c792ae8971ac9bb4e2c9c2527
 size 623

trainer_state.json

@@ -1,8 +1,8 @@
 {
-  "best_metric": 0.22213919460773468,
-  "best_model_checkpoint": "output/eminem/checkpoint-455",
+  "best_metric": 0.17033791542053223,
+  "best_model_checkpoint": "output/eminem/checkpoint-460",
   "epoch": 1.0,
-  "global_step": 455,
+  "global_step": 460,
   "is_hyper_param_search": false,
   "is_local_process_zero": true,
   "is_world_process_zero": true,
@@ -560,11 +560,25 @@
       "eval_samples_per_second": 21.946,
       "eval_steps_per_second": 2.756,
       "step": 455
+    },
+    {
+      "epoch": 1.0,
+      "learning_rate": 0.00010892206830726497,
+      "loss": 0.4359,
+      "step": 460
+    },
+    {
+      "epoch": 1.0,
+      "eval_loss": 0.17033791542053223,
+      "eval_runtime": 12.2909,
+      "eval_samples_per_second": 48.898,
+      "eval_steps_per_second": 6.183,
+      "step": 460
     }
   ],
-  "max_steps": 1365,
-  "num_train_epochs": 3,
-  "total_flos": 474636976128000.0,
+  "max_steps": 920,
+  "num_train_epochs": 2,
+  "total_flos": 479470878720000.0,
   "trial_name": null,
   "trial_params": null
 }

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5bc291dc42b38a7b304b7daeb4b46cfc64328ad099cb5a00588b0246f606e58b
+oid sha256:b2478f6ac251ccbd0eb17112df1fdac929c3ed4c313a16aa904d226b8a9b10b5
 size 3247