How to load it?
#1
by
AliceThirty
- opened
Hi, sorry to bother you but I really want to try this model. What endpoint can load it? Oobabooga, koboldcpp, lm-studio... ?
Thank you and sorry for my bad english.
I personally use TabbyAPI. But any backend that supports exl2 format should be able to run it. :)