rAIfle
/

bagel-jamba-v05-gguf

Inference Endpoints

Model card Files Files and versions Community

bagel-jamba-v05-gguf / README.md

rAIfle's picture

Update README.md

6c49ae4 verified 8 months ago

|

history blame contribute delete

291 Bytes

Quick quant of jondurbin/bagel-jamba-v05 to GGUF (Q4_K_M and Q8_0) since everyone else is sleeping.

Untested, YMMV, I don't usually do GGUFs. Use with this PR that's not been merged yet.