sonyashijin commited on
Commit
a3bff0a
·
verified ·
1 Parent(s): 1d20098

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -21,3 +21,14 @@ language:
21
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
21
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
24
+
25
+ # Evaluation
26
+
27
+ | Tasks |Version|Filter|n-shot|Metric| |Value| |Stderr|
28
+ |--------|------:|------|-----:|------|---|----:|---|-----:|
29
+ |pubmedqa| 1|none | 0|acc |↑ |0.716|± |0.0202|
30
+
31
+ Base model (unsloth/tinyllama-bnb-4bit)
32
+ | Tasks |Version|Filter|n-shot|Metric| |Value| |Stderr|
33
+ |--------|------:|------|-----:|------|---|----:|---|-----:|
34
+ |pubmedqa| 1|none | 0|acc |↑ |0.636|± |0.0215|