tokenizer / added_tokens.json
Caeden Rajoo
Upload tokenizer
94face6 verified
raw
history blame contribute delete
86 Bytes
{
"</s>": 8001,
"<mask>": 8004,
"<pad>": 8003,
"<s>": 8000,
"<unk>": 8002
}