Update README.md
Browse files
README.md
CHANGED
@@ -9,4 +9,8 @@ base_model:
|
|
9 |
tags:
|
10 |
- orpo
|
11 |
---
|
12 |
-
#
|
|
|
|
|
|
|
|
|
|
9 |
tags:
|
10 |
- orpo
|
11 |
---
|
12 |
+
# auryn_dpo_orpo_english
|
13 |
+
|
14 |
+
This is a ORPO fine-tune of meta-llama/Llama-3.2-1b trained on one epoch of https://huggingface.co/datasets/celsowm/auryn_dpo_orpo_english
|
15 |
+
|
16 |
+
Auryn is a fictional place intended to serve as a proof of concept for injecting knowledge into a large language model using ORPO.
|