Hello. Thank you for this model. Could you explain, please: what is pad_token_id and what is generator?

by NikolayKozloff - opened Aug 13, 2023

Aug 13, 2023

I want to make a ggml version of your model. Where should i set pad_token_id to 18610? Do i need to edit convert.py from llama.cpp repo or tokenizer_config.json?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment