Checkpoint queries.
#2
by
jusepv
- opened
I was wondering if the weights in the model you uploaded are the weights you trained?
When I download and load the weights, some layers seem to be untrained, are they vanilla LLaVA weights?
I've left multiple inquiries, please confirm.
Yes, our weights are the vanilla LLaVA weights. And our training followed a similar approach to LLaVA-Med, using delta training. We then merged the delta weights with the original LLaMA weights. We recommend referring to the specific instructions in this link, which may help resolve your issue.