Create README.md

README.md

@@ -0,0 +1,62 @@
+---
+language:
+- ko
+base_model:
+- aiyets/walrus-gemma-2-9b-it-v02
+license: gemma
+pipeline_tag: question-answering
+---
+
+![walrus](./walrus.jpeg)
+# Model Card for Model ID
+
+walrus 는 aiyets의 `한국어` 모델 미세조정 프로젝트입니다.
+gemma-2-9b-it 모델이 기본적으로 한국어를 잘하는 편이기 때문에 미세조정 대상으로 선정했습니다.
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+## Model Details
+
+### Model Description
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+
+## Evaluation
+
+- [LogicKor](https://github.com/instructkr/LogicKor). we evaluated by gpt-4o.
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+
+
+### Results
+
+- `LogicKor`
+
+| 모델 | 글쓰기(Writing) | 문법(Grammar) | 수학(Math) | 이해(Understanding) | 추론(Reasoning) | 코딩(Coding) | Single turn | Multi turn | Overall |
+| -- | -- | -- | -- | -- | -- | -- | -- | -- | -- |
+| gemma-2-9b-it| 9.14, 9.14| 6.71, 4.86| 8.57, 8.43| 8.43, 8.29| 8.71, 7.29| 9.29, 9.43| 8.43| 7.90| 8.19|
+| **walrus-gemma-2-9b-it-v02** | 9.29, 9.43 | 7.29, 5.00 | 7.86, 6.43 | 10.00, 9.57 | 9.00, 7.29 | 9.71, 10.00 | 8.86 | 7.95 | 8.40 |
+| walrus-gemma-2-9b-it-v01 | 9.14, 9.00 | 7.14, 5.71 | 8.71, 8.00 | 9.86, 9.57 | 8.43, 7.29 | 9.00, 9.43 | 8.71 | 8.17 | 8.44 |
+
+- [LogicKor result - default.jsonl](./LogicKor/default.jsonl)
+- [LogicKor result - 1-shot.jsonl](./LogicKor/1-shot.jsonl)
+- [LogicKor result - cot-1-shot.jsonl](./LogicKor/cot-1-shot.jsonl)
+
+#### Summary
+
+
+## Version history
+
+- `2024-10-23`: [v02 version](https://huggingface.co/aiyets/walrus-gemma-2-9b-it-v02) (fix bad eos, 1 epoch -> 2 epoch)
+- `2024-10-17`: [first version](https://huggingface.co/aiyets/walrus-gemma-2-9b-it-v01) (known issue: bad eos settings)
+
+
+## Contact
+
+- `[email protected]`