Add fp8 and GGUF if possible for us poor hw guys
#1
by
ryg81
- opened
Add fp8 and GGUF if possible for us poor hw guys
https://huggingface.co/Clybius/Flex.1-alpha-Q4_K_M-GGUF
I tested this and it works quite well - am positively surprised actually :)