Update README.md

671058b verified 8 months ago

311 Bytes

metadata

license: mit
language:
  - en
tags:
  - text generation
datasets:
  - fhswf/TinyStoriesV2_cleaned

BPE Tokenizer for TinyStoriesV2

Based on get-neo BPE Tokenizer, but with a smaller vocabulary. Trained with TinyStoriesV2.