Prompt format?

#2
by notafraud - opened

What's the prompt format for this model? Is it Mistral V3, like Nemo? It doesn't seem to work with it.

Its similar to the Alpaca Prompt format

Alright, it works with full Aplaca:

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

However, it doesn't stop generation without system prompt (short Alpaca) for some reason.

Can you please add the prompt format into description to avoid confusion? The base model has a different format.

Ah yes thank you for the fix. I will update it right away!

Spestly changed discussion status to closed

Sign up or log in to comment