Cannot use in SillyTavern
Hi there, I added the q5 quant to Ollama and tried running it in SIllyTavern but the model is outputting nonsense. I didn't have the same problem with v1.2. I tried different samplers and prompt templates but it's still not functioning correctly.
Tried another quant by mradermacher but it still isn't working
I can confirm it's not working with current koboldcpp 1.79.1 + SillyTavern.
Yes its broken
;-;
yeah, version v1.2 works fine but this outputs : . : - . . - -
when fix?
Hi,
I have a issue too. With LM Studio, i have this message:
Failed to send message
Cannot call something that is not a function: got UndefinedValue
But 1.2 work fine
mradermacher's quants don't work ether using oobabooga's GUI.
Hopefully it gets fixed soon-ish
would like to be able to try out v1.3 but for now might have to stick with 1.2 if it's that badly corrupted