Update README.md
Browse files
README.md
CHANGED
|
@@ -15,6 +15,8 @@ tags:
|
|
| 15 |
|
| 16 |
This repo contains a [70% sparse Llama 2 7B](https://huggingface.co/neuralmagic/Llama-2-7b-pruned70-retrained) finetuned for chat tasks using the [UltraChat 200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k) dataset.
|
| 17 |
|
|
|
|
|
|
|
| 18 |
**Authors**: Neural Magic, Cerebras
|
| 19 |
|
| 20 |
## Usage
|
|
|
|
| 15 |
|
| 16 |
This repo contains a [70% sparse Llama 2 7B](https://huggingface.co/neuralmagic/Llama-2-7b-pruned70-retrained) finetuned for chat tasks using the [UltraChat 200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k) dataset.
|
| 17 |
|
| 18 |
+
Official model weights from [Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment](https://arxiv.org/abs/2405.03594).
|
| 19 |
+
|
| 20 |
**Authors**: Neural Magic, Cerebras
|
| 21 |
|
| 22 |
## Usage
|