August4293
/

mistral_self_alignment_DPO

Inference Endpoints

Model card Files Files and versions Community

mistral_self_alignment_DPO / adapter_model.safetensors

Commit History

initial adapter with DPO on sample dataset and 1 epoch

36d527d
verified

August4293 commited on Mar 17, 2024