Model failing to load on LM Studio
#6
by
morieskie
- opened
🥲 Failed to load the model
Failed to load model
llama.cpp error: 'error loading model architecture: unknown model architecture: 'mllama''
🥲 Failed to load the model Failed to load model llama.cpp error: 'error loading model architecture: unknown model architecture: 'mllama''
Hi @morieskie I am having the same issue. Seems like llama.cpp has not yet supported the vision-language version of llama3 right now. Someone has already raised the issue in the Github repo of llama.cpp: https://github.com/ggerganov/llama.cpp/issues/9663
In order to load this model on LM Studio you have to rename MMPROJ file to: mmproj-Llama-3.2-11B-Vision-Instruct.f16.gguf
Then LM Studio will automatically recognize it as VISION model. @dootmaan @morieskie
Although I still got:
Error loading model.
(Exit code: 18446744073709515000). Unknown error. Try a different model and/or config.