PJMixers-Archive
/

LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA

Model card Files Files and versions Community

LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA / README.md

xzuyn's picture

Create README.md

6bb16e6 verified 7 months ago

|

335 Bytes

	---
	datasets:
	- PJMixers/antiven0m_catboros-3.2-dpo-PreferenceShareGPT
	---
	![Chosen/Rejected Reward Graph](https://huggingface.co/PJMixers/LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA/resolve/main/chosen_rejected_reward_graph.png)

	Trained on [antiven0m/catboros-3.2-dpo](https://huggingface.co/datasets/antiven0m/catboros-3.2-dpo).