Sheared LLaMA on Deita-6K
This is the supervised fine-tuned version of Sheared LLaMA 2.7B on Deita-6k for 2 epochs.
This model is for fair comparison with LLaMA-MoE-v1-sft.
This is the supervised fine-tuned version of Sheared LLaMA 2.7B on Deita-6k for 2 epochs.
This model is for fair comparison with LLaMA-MoE-v1-sft.