Finetuning codes for SmolVLM

#25
by 2U1 - opened

Yet there is a finetuning script made with notebook file in the smolLM repo, I've added some options that could

  • Select module to finetune (vision, connector, llm)
  • Finetune video
  • Using deepspeed
  • Using fp8 trainiong via ms_amp

Feel free to use and giving feedbacks!

https://github.com/2U1/SmolVLM-Finetune

Sign up or log in to comment