AINovice2005 commited on
Commit
86b52ca
ยท
verified ยท
1 Parent(s): 5d18c11

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -53,7 +53,7 @@ if __name__ == "__main__":
53
  ```
54
 
55
  ๐‘๐ž๐ฌ๐ฎ๐ฅ๐ญ๐ฌ:
56
- Firslty, a higher learning rate was required for the model to train the model on a dataset, training methods such as SFT and ORPO
57
  with PEFT failed to restore convergence.Secondly, training only using PEFT helped to restore partial model convergence.
58
 
59
  Lastly, future experiments to restore model convergence will require a systematic training and eval strategy.
 
53
  ```
54
 
55
  ๐‘๐ž๐ฌ๐ฎ๐ฅ๐ญ๐ฌ:
56
+ Firstly, a higher learning rate was required for the model to train the model on a dataset, training methods such as SFT and ORPO
57
  with PEFT failed to restore convergence.Secondly, training only using PEFT helped to restore partial model convergence.
58
 
59
  Lastly, future experiments to restore model convergence will require a systematic training and eval strategy.