emeraldgoose
/

bad-korean-tokenizer

Inference Endpoints

Model card Files Files and versions Community

bad-korean-tokenizer / README.md

emeraldgoose's picture

Create README.md

0a3d33a about 3 years ago

|

history blame contribute delete

158 Bytes

	KcELECTRA([https://github.com/Beomi/KcELECTRA](https://github.com/Beomi/KcELECTRA))의 Tokenizer에서 [UNK]로 대체되는 토큰들을 추가했습니다.