File size: 555 Bytes
850df74 a51530d 1a20738 11d69ee 1a20738 a14140c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
license: apache-2.0
datasets:
- celsowm/auryn_dpo_orpo_english
language:
- en
base_model:
- meta-llama/Llama-3.2-1B
tags:
- orpo
---
# auryn_dpo_orpo_english
This is a ORPO fine-tune of meta-llama/Llama-3.2-1b trained on three epochs of https://huggingface.co/datasets/celsowm/auryn_dpo_orpo_english
Auryn is a fictional place intended to serve as a proof of concept for injecting knowledge into a large language model using ORPO.
Tutorial here: https://medium.com/@celsoaf/injecting-new-knowledge-into-an-llm-via-fine-tuning-with-orpo-017d3bfdb11b |