Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
mfromm commited on
Commit
ee1e3f9
·
verified ·
1 Parent(s): f747383

Update gptx_tokenizer.py

Browse files
Files changed (1) hide show
  1. gptx_tokenizer.py +1 -1
gptx_tokenizer.py CHANGED
@@ -17,7 +17,7 @@ PAD_TOKEN = "<pad>"
17
  BOS_TOKEN = "<s>"
18
  EOS_TOKEN = "</s>"
19
  UNK_TOKEN = "<unk>"
20
- REPO_ID = "openGPT-X/Teuken-7B-base-v0.4"
21
 
22
  class HFGPTXTokenizer(PreTrainedTokenizer):
23
  """
 
17
  BOS_TOKEN = "<s>"
18
  EOS_TOKEN = "</s>"
19
  UNK_TOKEN = "<unk>"
20
+ REPO_ID = "openGPT-X/Teuken-7B-chat-v0.4"
21
 
22
  class HFGPTXTokenizer(PreTrainedTokenizer):
23
  """