Could you share the de-distill training scripts?
#6
by
MataBear
- opened
I have enough computing resource to give it a try :)
Also, correct me if I misunderstand something. But I think de-distillation requires Flux-Pro, right? Are you using some tricks or alternatives?
That will be the ideal scenario but because the pro model is not public as I understand this de-distillation process used a simulated teacher model.
Can you do this by fine tuning flux dev on koyah but with a guidance of 3.5?
Yes, please share the scripts. The author wants to fine-tune this, and I have some $ to burn and would like to as well.