Model Card for online-dpo-qwen2-3
This model is a fine-tuned version of Qwen/Qwen2-0.5B-Instruct on the https://huggingface.co/datasets/trl-lib/ultrafeedback-prompt dataset.
- Downloads last month
- 16
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.