TheTsar1209 commited on
Commit
052e690
·
verified ·
1 Parent(s): 0bf4af1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -9,8 +9,24 @@ tags:
9
  license: apache-2.0
10
  language:
11
  - en
 
 
 
 
 
 
 
12
  ---
13
 
 
 
 
 
 
 
 
 
 
14
  # Uploaded model
15
 
16
  - **Developed by:** TheTsar1209
@@ -19,4 +35,4 @@ language:
19
 
20
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
9
  license: apache-2.0
10
  language:
11
  - en
12
+ datasets:
13
+ - HuggingFaceTB/smoltalk
14
+ - HuggingFaceTB/finemath
15
+ - lightblue/tagengo-gpt4
16
+ - LDJnr/Capybara
17
+ - argilla/ifeval-like-data
18
+ - AIRRC/Eudaimonic
19
  ---
20
 
21
+ A Fishy Model
22
+
23
+ This model was trained with SFT using Unsloth on the ChatML format with 8k context. Carp models are trained with a combination of pretrain, instruct, and chat datasets.
24
+
25
+ # Changes
26
+ - Training dataset had some more "slop" removed.
27
+ - Some datasets were added and deleted from training.
28
+ - Datasets were reorganized.
29
+
30
  # Uploaded model
31
 
32
  - **Developed by:** TheTsar1209
 
35
 
36
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
37
 
38
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)