tokenizer

#3
by Wabyy - opened

which Chinese tokenizer should I use if I want to finetune the mamba-115M-chinese in a downstream tasks

I want to fine tune it for text classification tasks, and I need to use a Chinese tokenizer.Thank you so much!

Sign up or log in to comment