- Developed by: cstr
- License: apache-2.0
- Finetuned from model : vonjack/Phi-3-mini-4k-instruct-LLaMAfied
This is a quick experiment with only 150 orpo steps from a german dataset.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for cstr/phi-3-orpo-v8_16
Base model
vonjack/Phi-3-mini-4k-instruct-LLaMAfied