---
library_name: peft
---
## Training procedure

### Framework versions


- PEFT 0.4.0

{'eval_loss': 1.0666293746908195e-05, 'eval_runtime': 11898.68, 'eval_samples_per_second': 2.641, 'eval_steps_per_second': 0.33, 'epoch': 1.0}
{'train_runtime': 25159.3445, 'train_samples_per_second': 0.535, 'train_steps_per_second': 0.013, 'train_loss': 0.033493353224400835, 'epoch': 1.0}
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 336/336 [6:59:18<00:00, 74.88s/it]
[2024-08-22 13:47:25,207] [INFO] [launch.py:347:main] Process 25359 exits successfully.
[2024-08-22 13:47:26,209] [INFO] [launch.py:347:main] Process 25360 exits successfully.
[2024-08-22 13:47:26,209] [INFO] [launch.py:347:main] Process 25361 exits successfully.
wandb: | 0.033 MB of 0.044 MB uploaded
wandb: Run history:
wandb:                      eval/loss ▁
wandb:                   eval/runtime ▁
wandb:        eval/samples_per_second ▁
wandb:          eval/steps_per_second ▁
wandb:                    train/epoch ▁▁▁▁▂▂▂▂▂▃▃▃▃▃▃▄▄▄▄▄▅▅▅▅▅▅▆▆▆▆▆▆▇▇▇▇▇███
wandb:              train/global_step ▁▁▁▂▂▂▂▂▂▃▃▃▃▃▃▄▄▄▄▄▅▅▅▅▅▅▆▆▆▆▆▆▇▇▇▇▇███
wandb:            train/learning_rate ▄███████▇▇▇▇▇▆▆▆▆▅▅▅▅▄▄▄▃▃▃▃▂▂▂▂▂▁▁▁▁▁▁▁
wandb:                     train/loss █▃▃▂▂▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁
wandb:               train/total_flos ▁
wandb:               train/train_loss ▁
wandb:            train/train_runtime ▁
wandb: train/train_samples_per_second ▁
wandb:   train/train_steps_per_second ▁
wandb:
wandb: Run summary:
wandb:                      eval/loss 1e-05
wandb:                   eval/runtime 11898.68
wandb:        eval/samples_per_second 2.641
wandb:          eval/steps_per_second 0.33
wandb:                    train/epoch 1.0
wandb:              train/global_step 336
wandb:            train/learning_rate 0.0
wandb:                     train/loss 0.0
wandb:               train/total_flos 653027262332928.0
wandb:               train/train_loss 0.03349
wandb:            train/train_runtime 25159.3445
wandb: train/train_samples_per_second 0.535
wandb:   train/train_steps_per_second 0.013
wandb:
wandb: 🚀 View run ethereal-lion-28 at: https://wandb.ai/pomichterstash-massachusetts-institute-of-technology/huggingface/runs/9dtkzox9
wandb: ⭐️ View project at: https://wandb.ai/pomichterstash-massachusetts-institute-of-technology/huggingface
wandb: Synced 5 W&B file(s), 0 media file(s), 2 artifact file(s) and 0 other file(s)
wandb: Find logs at: ./wandb/run-20240822_064756-9dtkzox9/logs