celsowm commited on
Commit
1a20738
·
verified ·
1 Parent(s): a51530d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -9,4 +9,8 @@ base_model:
9
  tags:
10
  - orpo
11
  ---
12
- #A very simple example of fine tunning using ORPO
 
 
 
 
 
9
  tags:
10
  - orpo
11
  ---
12
+ # auryn_dpo_orpo_english
13
+
14
+ This is a ORPO fine-tune of meta-llama/Llama-3.2-1b trained on one epoch of https://huggingface.co/datasets/celsowm/auryn_dpo_orpo_english
15
+
16
+ Auryn is a fictional place intended to serve as a proof of concept for injecting knowledge into a large language model using ORPO.