Update README.md
Browse files
README.md
CHANGED
@@ -6,17 +6,31 @@ tags:
|
|
6 |
- text-generation-inference
|
7 |
- transformers
|
8 |
- unsloth
|
9 |
-
-
|
10 |
- trl
|
|
|
11 |
base_model: unsloth/llama-2-7b-chat-bnb-4bit
|
|
|
|
|
12 |
---
|
13 |
|
14 |
-
# Uploaded model
|
15 |
-
|
16 |
- **Developed by:** Shekswess
|
17 |
- **License:** apache-2.0
|
18 |
- **Finetuned from model :** unsloth/llama-2-7b-chat-bnb-4bit
|
19 |
|
20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
22 |
-
[
|
|
|
6 |
- text-generation-inference
|
7 |
- transformers
|
8 |
- unsloth
|
9 |
+
- mistral
|
10 |
- trl
|
11 |
+
- medical
|
12 |
base_model: unsloth/llama-2-7b-chat-bnb-4bit
|
13 |
+
datasets:
|
14 |
+
- Shekswess/medical_llama_instruct_dataset_short
|
15 |
---
|
16 |
|
|
|
|
|
17 |
- **Developed by:** Shekswess
|
18 |
- **License:** apache-2.0
|
19 |
- **Finetuned from model :** unsloth/llama-2-7b-chat-bnb-4bit
|
20 |
|
21 |
+
To utilize the finetuning of the model, you need to use the gemma instruction prompt template for this medical version of the model:
|
22 |
+
```
|
23 |
+
[INST] Answer the question truthfully, you are a medical professional. This is the question: {question} [/INST]
|
24 |
+
```
|
25 |
+
|
26 |
+
Metrics:
|
27 |
+
|
28 |
+
- train_runtime: 4161.8304
|
29 |
+
- train_samples_per_second: 0.721
|
30 |
+
- train_steps_per_second: 0.09
|
31 |
+
- total_flos: 5.622915296673792e+16
|
32 |
+
- train_loss: 1.0950924614270527
|
33 |
+
- steps: 375
|
34 |
+
- epoch: 1.0
|
35 |
|
36 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6569f13004643352df96e40f/x4e5tNog69QDN0l2-9F8S.png)
|