espressor/meta-llama.Llama-2-13b-chat-hf_W8A8_FP8

meta-llama/Llama-2-13b-chat-hf - W8A8_FP8 Compression

This is a compressed model using llmcompressor.

Compression Configuration

• Base Model: meta-llama/Llama-2-13b-chat-hf
• Compression Scheme: W8A8_FP8
• Dataset: HuggingFaceH4/ultrachat_200k
• Dataset Split: train_sft
• Number of Samples: 512
• Preprocessor: chat
• Maximum Sequence Length: 4096

Sample Output

Prompt:

<s>[INST] Who is Alan Turing? [/INST]

Output:

<s><s> [INST] Who is Alan Turing? [/INST]  Alan Turing (1912-1954) was a British mathematician, computer scientist, and logician who made significant contributions to the fields of computer science, mathematics, and artificial intelligence. He is widely considered to be one of the most important figures in the history of computer science and artificial intelligence.

Turing was born in London, England, and grew up in a family of mathematicians. He studied at Cambridge University, where he earned his undergraduate degree in mathematics and later earned his PhD in mathematics. During World War II, Turing worked at the Government Code and Cy

Evaluation