Ellight commited on
Commit
42c6ace
·
verified ·
1 Parent(s): 71c0530

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -2
README.md CHANGED
@@ -13,9 +13,18 @@ datasets:
13
 
14
  # Model Card for Lite-Oute-1-65M-smol-smoltalk
15
 
16
- This model is a fine-tuned version of [OuteAI/Lite-Oute-1-65M](https://huggingface.co/OuteAI/Lite-Oute-1-65M).
17
- It has been trained using [TRL](https://github.com/huggingface/trl).
18
 
 
 
 
 
 
 
 
 
 
19
  ## Quick start
20
 
21
  ```python
@@ -33,6 +42,11 @@ print(output["generated_text"])
33
 
34
  This model was trained with SFT.
35
 
 
 
 
 
 
36
  ### Framework versions
37
 
38
  - TRL: 0.12.1
 
13
 
14
  # Model Card for Lite-Oute-1-65M-smol-smoltalk
15
 
16
+ This model is a fine-tuned version of [OuteAI/Lite-Oute-1-65M](https://huggingface.co/OuteAI/Lite-Oute-1-65M). Lite-Oute-1-65M (Base) is an experimental ultra-compact base model in the Lite series, built on the LLaMA architecture and comprising approximately 65 million parameters.
17
+ It has been trained using [TRL](https://github.com/huggingface/trl). Below the finetuned model is evaluated on common benchmarks.
18
 
19
+ ## Benchmarks:
20
+
21
+ | Metric | Lite-Oute-1-65M | Lite-Oute-1-65M-smol-smoltalk |
22
+ |------------------|--------------|-------------|
23
+ | HellaSwag | 28.27 | **28.56** |
24
+ | ARC (Average) | **31.85** | 28.275 |
25
+ | PIQA | **60.45** | 59.47 |
26
+ | Winogrande | 51.7 | **53.59** |
27
+ | MMLU | 23.05 | 22.9 |
28
  ## Quick start
29
 
30
  ```python
 
42
 
43
  This model was trained with SFT.
44
 
45
+
46
+ ## Risk Disclaimer
47
+
48
+ By using this model, you acknowledge that you understand and assume the risks associated with its use. You are solely responsible for ensuring compliance with all applicable laws and regulations. We disclaim any liability for problems arising from the use of this open-source model, including but not limited to direct, indirect, incidental, consequential, or punitive damages. We make no warranties, express or implied, regarding the model's performance, accuracy, or fitness for a particular purpose. Your use of this model is at your own risk, and you agree to hold harmless and indemnify us, our affiliates, and our contributors from any claims, damages, or expenses arising from your use of the model.
49
+
50
  ### Framework versions
51
 
52
  - TRL: 0.12.1