Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
DUAL-GPO
/
phi-2-dpo-chatml
like
0
Follow
DUAL Group
2
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
phi
alignment-handbook
Generated from Trainer
trl
dpo
custom_code
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Use this model
main
phi-2-dpo-chatml
/
adapter_model.safetensors
Commit History
Model save
97b1fbc
verified
lole25
commited on
May 18, 2024
Training in progress, step 900
b10968e
verified
lole25
commited on
May 18, 2024
Training in progress, step 800
7591a32
verified
lole25
commited on
May 18, 2024
Training in progress, step 700
8823604
verified
lole25
commited on
May 18, 2024
Training in progress, step 600
1ed9cd4
verified
lole25
commited on
May 18, 2024
Training in progress, step 500
e32269d
verified
lole25
commited on
May 18, 2024
Training in progress, step 400
4f10ba4
verified
lole25
commited on
May 18, 2024
Training in progress, step 100
aafeffb
verified
lole25
commited on
May 18, 2024