Finetuning possible?
#1
by
Fyahdii
- opened
Hi!
Attempting to use this model for a specific use case in nutrition. Just wondering is further finetuning on this model possible?
Hey, I'm not sure if I understand you correctly.
- If you mean calls to specific functions related to the nutrition domain, then you do not need to fine-tune anything further. I have specially trained the model so that you can use any functions with any domains.
- But if you mean additional fine-tuning this model on specific domain (data about nutriton), it is quite possible that you will find yourself at an unpleasant crossroads with catastrophically forgetting about the tasks of the model that I have trained.
In this model finetuning I have used limited number of data (no more than 200 examples) and LoRa with only 1 epoch of training.
I hope this answers your question.
Just realising my question wasn't very clear. Yes, I meant additional finetuning. Thank you for the quick response!
DiTy
changed discussion status to
closed