codestar12
/

webdataset_filtered_converted

Model card Files Files and versions Community

webdataset_filtered_converted / tokenizer_config.json

Commit History

Update tokenizer_config.json

85e237f

codestar12 commited on Apr 6, 2023

pad token got lost in hf conversion (#1)

0c9cb5d

sam-mosaic commited on Apr 6, 2023

Upload tokenizer

4617d6f

codestar12 commited on Apr 5, 2023