Update README.md

README.md

@@ -55,8 +55,8 @@ response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
 ```
 
 # Notes:
-- For small datasets with narrow content which the model already has well, and doesn't want the model to forget the knowledge => Just need to focus on o. 
-- Fine-tuned lora with rank = 16 and alpha = 32, epoch = 1, linear (optim)
+- For small datasets with narrow content which the model already has well, and doesn't want the model to forget the knowledge => Just need to focus on q, o. 
+- Fine-tuned lora with rank = 16 and alpha = 32, epoch = 1, cosine (optim)
 - DoRA
   
 # Improvement