eliebak
/

the-tokenizer-v2

Inference Endpoints

Model card Files Files and versions Community

the-tokenizer-v2 / added_tokens.json

eliebak's picture

eliebak HF staff

Upload tokenizer

4da8c10 verified 7 months ago

history blame contribute delete

51 Bytes

	{
	"<\|im_end\|>": 49153,
	"<\|im_start\|>": 49152
	}