jingyeom commited on
Commit
0945d3f
·
verified ·
1 Parent(s): 0a24372

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -1
README.md CHANGED
@@ -1,3 +1,23 @@
1
  ---
2
  license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ ---
4
+ ## Model
5
+ base_model : yanolja/KoSOLAR-10.7B-v0.2
6
+ ## Dataset
7
+ * 공개 데이터 수집
8
+ * Deduplicating Training Data Makes Language Models Better 알고리즘 활용
9
+
10
+ ## Code
11
+ ```python
12
+ from transformers import AutoModelForCausalLM, AutoTokenizer
13
+ import torch
14
+
15
+ model_name = "jingyeom/KoSoLAR-10.7B-v0.2_1.4_dedup"
16
+ model = AutoModelForCausalLM.from_pretrained(
17
+ model_name,
18
+ )
19
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
20
+ ```
21
+
22
+ ## Benchmark
23
+ **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**