Shekswess commited on
Commit
ec63fbb
·
verified ·
1 Parent(s): d8cc502

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -5
README.md CHANGED
@@ -6,17 +6,31 @@ tags:
6
  - text-generation-inference
7
  - transformers
8
  - unsloth
9
- - llama
10
  - trl
 
11
  base_model: unsloth/llama-2-7b-chat-bnb-4bit
 
 
12
  ---
13
 
14
- # Uploaded model
15
-
16
  - **Developed by:** Shekswess
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** unsloth/llama-2-7b-chat-bnb-4bit
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
6
  - text-generation-inference
7
  - transformers
8
  - unsloth
9
+ - mistral
10
  - trl
11
+ - medical
12
  base_model: unsloth/llama-2-7b-chat-bnb-4bit
13
+ datasets:
14
+ - Shekswess/medical_llama_instruct_dataset_short
15
  ---
16
 
 
 
17
  - **Developed by:** Shekswess
18
  - **License:** apache-2.0
19
  - **Finetuned from model :** unsloth/llama-2-7b-chat-bnb-4bit
20
 
21
+ To utilize the finetuning of the model, you need to use the gemma instruction prompt template for this medical version of the model:
22
+ ```
23
+ [INST] Answer the question truthfully, you are a medical professional. This is the question: {question} [/INST]
24
+ ```
25
+
26
+ Metrics:
27
+
28
+ - train_runtime: 4161.8304
29
+ - train_samples_per_second: 0.721
30
+ - train_steps_per_second: 0.09
31
+ - total_flos: 5.622915296673792e+16
32
+ - train_loss: 1.0950924614270527
33
+ - steps: 375
34
+ - epoch: 1.0
35
 
36
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6569f13004643352df96e40f/x4e5tNog69QDN0l2-9F8S.png)