README.md

metadata

license: apache-2.0
language:
  - fr
  - it
  - de
  - es
  - en
tags:
  - moe

Model Card for cloudyu/Mixtral-8x7B-Instruct-v0.1-DPO

• try to improve mistralai/Mixtral-8x7B-Instruct-v0.1 by DPO training

• DPO Trainer

Metrics improved by Truthful DPO traingin after 100 steps