Use model in LMStudio
#8
by
MrZoidberg
- opened
How to run this model in LMStudio? I have the following error:
"llama.cpp error: 'error loading model architecture: unknown model architecture: '''"
You need GGUF quants
You can get the GGUF quants here https://huggingface.co/andrijdavid/Mixtral-8x22B-v0.1-GGUF