Doesn't work with current version of llama.cpp

#1
by Fishfishfishfishfish - opened

raise NotImplementedError("BPE pre-tokenizer was not recognized - update get_vocab_base_pre()") when trying to quantize

Fishfishfishfishfish changed discussion status to closed

Sign up or log in to comment