Ellight
/

Lite-Oute-1-65M-smol-smoltalk

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

Ellight commited on Nov 28, 2024

Commit

e8c6ce2

·

verified ·

1 Parent(s): 42c6ace

Update README.md

Files changed (1) hide show

README.md +7 -7

README.md CHANGED Viewed

@@ -18,13 +18,13 @@ It has been trained using [TRL](https://github.com/huggingface/trl). Below the f
 ## Benchmarks:
-| Metric           | Lite-Oute-1-65M | Lite-Oute-1-65M-smol-smoltalk |
-|------------------|--------------|-------------|
-| HellaSwag        | 28.27     | **28.56**        |
-| ARC (Average)    | **31.85**     | 28.275        |
-| PIQA             | **60.45**     | 59.47        |
-| Winogrande       | 51.7     | **53.59**       |
-| MMLU             | 23.05         | 22.9       |
 ## Quick start
 ```python

 ## Benchmarks:
+| Metric           | Lite-Oute-1-65M | Lite-Oute-1-65M-smol-smoltalk |SmolLM2-135M-Instruct |
+|------------------|--------------|-------------|-------------|
+| HellaSwag        | 28.27     | 28.56        |**42.83**|
+| ARC (Average)    | 31.85     | 28.275        |**38.37**|
+| PIQA             | 60.45     | 59.47        |**66.7**|
+| Winogrande       | 51.7     | **53.59**       | 51.54|
+| MMLU             | **23.05**         | 22.9       |22.96|
 ## Quick start
 ```python