Update README.md
Browse files
README.md
CHANGED
@@ -20,6 +20,20 @@ datasets:
|
|
20 |
- With base model, apply DPO to the small amount of layers with the dataset written above, saved just an adapter part.
|
21 |
- Merge the base model and the tuned adapter together.
|
22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
**Log**
|
24 |
- 2024.01.25: Initial version Upload
|
25 |
|
@@ -37,18 +51,4 @@ datasets:
|
|
37 |
publisher = { Hugging Face }
|
38 |
}
|
39 |
|
40 |
-
```
|
41 |
-
|
42 |
-
**Model**
|
43 |
-
``` python
|
44 |
-
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
|
45 |
-
model = AutoModelForCausalLM.from_pretrained(
|
46 |
-
"dddsaty/Open_Ko_SOLAR_DPO_Merge_v0.1",
|
47 |
-
low_cpu_mem_usage = True,
|
48 |
-
torch_dtype = torch.float16,
|
49 |
-
device_map = device_map,
|
50 |
-
)
|
51 |
-
|
52 |
-
tokenizer = AutoTokenizer.from_pretrained("dddsaty/Open_Ko_SOLAR_DPO_Merge_v0.1")
|
53 |
-
|
54 |
-
```
|
|
|
20 |
- With base model, apply DPO to the small amount of layers with the dataset written above, saved just an adapter part.
|
21 |
- Merge the base model and the tuned adapter together.
|
22 |
|
23 |
+
**Usage**
|
24 |
+
``` python
|
25 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
|
26 |
+
model = AutoModelForCausalLM.from_pretrained(
|
27 |
+
"dddsaty/Open_Ko_SOLAR_DPO_Merge_v0.1",
|
28 |
+
low_cpu_mem_usage = True,
|
29 |
+
torch_dtype = torch.float16,
|
30 |
+
device_map = device_map,
|
31 |
+
)
|
32 |
+
|
33 |
+
tokenizer = AutoTokenizer.from_pretrained("dddsaty/Open_Ko_SOLAR_DPO_Merge_v0.1")
|
34 |
+
|
35 |
+
```
|
36 |
+
|
37 |
**Log**
|
38 |
- 2024.01.25: Initial version Upload
|
39 |
|
|
|
51 |
publisher = { Hugging Face }
|
52 |
}
|
53 |
|
54 |
+
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|