|
--- |
|
license: apache-2.0 |
|
language: |
|
- ko |
|
library_name: transformers |
|
pipeline_tag: text-generation |
|
datasets: |
|
- maywell/ko_Ultrafeedback_binarized |
|
--- |
|
|
|
**Explanation** |
|
- With the base model, applied DPO to the small amount of layers with the open dataset , saved just the adapter part |
|
- Merged the base model and the tuned adapter together |
|
|
|
**Base Model** |
|
- [beomi/OPEN-SOLAR-KO-10.7B](https://huggingface.co/beomi/OPEN-SOLAR-KO-10.7B) |
|
|
|
**Used Corpus** |
|
- [maywell/ko_Ultrafeedback_binarized](https://huggingface.co/datasets/maywell/ko_Ultrafeedback_binarized) |
|
|
|
**Score** |
|
|Average|Ko-ARC|Ko-HellaSwag|Ko-MMLU|Ko-TruthfulQA|Ko-CommonGen V2| |
|
|:---:|:---:|:---:|:---:|:---:|:---:| |
|
|52.83|50|60.55|48.8|71.51|43.65|61.16| |
|
|
|
**Log** |
|
- 2024.01.25: Initial version Upload |
|
- 2024.02.10: Readme updated |
|
- 2024.02.11: Score updated |
|
|
|
**LICENSE** |
|
- Apache 2.0 |
|
|
|
**Citation** |
|
- beomi/OPEN-SOLAR-KO-10.7B |
|
``` |
|
@misc {solar_ko_junbum_2023, |
|
author = { {L. Junbum} }, |
|
title = { Solar-Ko-10.7b }, |
|
year = 2024, |
|
url = { https://huggingface.co/beomi/SOLAR-KO-10.7B }, |
|
publisher = { Hugging Face } |
|
} |
|
|
|
``` |
