raceBERT / tokenizer_config.json
pparasurama's picture
add tokenizer
dc58658
raw
history blame contribute delete
82 Bytes
{"return_special_tokens_mask": true, "tokenizer_class": "PreTrainedTokenizerFast"}