Model is broken in latest llama.cpp
#1
by
jackboot
- opened
The model doesn't load in llama.cpp anymore due to code changes. GGUF have to be remade from scratch :(
Sorry for the late Answer (didn't notice...)
Hopefully you already found the https://huggingface.co/maddes8cht/tiiuae-falcon-40b-gguf
:)