Nepali_Tokenizer / README.md
universalml's picture
Update README.md
b25d006 verified
metadata
library_name: transformers
license: mit
language:
  - en
  - ne
base_model:
  - microsoft/Phi-3.5-mini-instruct

Model Details

A tokenizer designed for the Nepali language, supporting both word and subword tokenization. Ideal for Nepali NLP tasks such as language modeling, text classification, and more, addressing the specific needs of Nepali script and grammar

Model Description

  • Developed by: Universalml Inc.
  • Funded by : AWS , DigitalOcean
  • Language(s) (NLP): Nepali
  • License: MIT
  • Finetuned from model optional: microsoft/Phi-3.5-mini-instruct