File size: 1,500 Bytes
9595aa2 3b799fa 9595aa2 6e2e5bc 9595aa2 3b799fa 9595aa2 2f13111 9595aa2 2f13111 9595aa2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
---
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- meta-llama/Llama-3.2-1B
library_name: transformers, deltazip
---
## meta-llama/Llama-3.2-1B - 4b_2n4m_128bs Compression
This is a compressed model using [deltazip](https://github.com/eth-easl/deltazip).
[Paper](https://arxiv.org/abs/2312.05215), [Compression Tool](https://github.com/eth-easl/deltazip), [Inference Engine (Soon)](https://github.com/eth-easl/deltazip).
## Compression Configuration
- Base Model: meta-llama/Llama-3.2-1B
- Compression Scheme: 4b_2n4m_128bs
- Dataset: HuggingFaceH4/ultrachat_200k
- Dataset Split: train_sft
- Max Sequence Length: 2048
- Number of Samples: 256
## Sample Output
#### Prompt:
```
[{'role': 'user', 'content': 'Who is Alan Turing?'}]
```
#### Output:
```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
Cutting Knowledge Date: December 2023
Today Date: 05 Dec 2024
<|eot_id|><|start_header_id|>user<|end_header_id|>
Who is Alan Turing?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Alan Turing (1912-1954) was a British mathematician, computer scientist, logician, and philosopher who made significant contributions to computer science, artificial intelligence, and cryptography. He is widely regarded as one of the most important figures in the development of computer science and is often referred to as the "father of computer science."
Turing was born in London, England, and grew up in a family of modest means. He developed
```
## Evaluation
<TODO>
|