renyiyu commited on
Commit
748db81
·
verified ·
1 Parent(s): 500db89

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -5,7 +5,7 @@ base_model: meta-llama/Llama-2-7b-hf
5
 
6
  # Model Details
7
 
8
- - Supervised finetuning (sft) based on [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on [yahma/alpaca-cleaned](https://huggingface.co/datasets/yahma/alpaca-cleaned)
9
  - Trained with Deepspeed ZeRO-1 + TRL + QLoRA + Flash-Attntion 2 within 1h with 3090x4
10
  - The LoRa adapter is uploaded
11
 
 
5
 
6
  # Model Details
7
 
8
+ - Supervised fine-tuning (sft) based on [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on [yahma/alpaca-cleaned](https://huggingface.co/datasets/yahma/alpaca-cleaned)
9
  - Trained with Deepspeed ZeRO-1 + TRL + QLoRA + Flash-Attntion 2 within 1h with 3090x4
10
  - The LoRa adapter is uploaded
11