Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
alvarobartt
/
Mistral-7B-v0.1-ORPO-PEFT
like
1
Text Generation
PEFT
TensorBoard
Safetensors
alvarobartt/dpo-mix-7k-simplified
argilla/dpo-mix-7k
English
mistral
orpo
qlora
trl
conversational
4-bit precision
bitsandbytes
arxiv:
2403.07691
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
main
Mistral-7B-v0.1-ORPO-PEFT
File size: 51 Bytes
cd15223
1
2
3
4
5
{
"<|im_end|>"
:
32001
,
"<|im_start|>"
:
32000
}