This model was converted to FP8 format from watt-ai/watt-tool-8B using the llmcompressor library by vLLM. Refer to the original model card for more details on the model.

Downloads last month: 82

Safetensors

Model size

8.03B params

Tensor type

BF16

F8_E4M3

Inference API

Unable to determine this model's library. Check the docs .

Model tree for tolgaakar/watt-tool-8B-FP8-Dynamic

Base model

meta-llama/Llama-3.1-8B

Finetuned

meta-llama/Llama-3.1-8B-Instruct

Finetuned

watt-ai/watt-tool-8B

Quantized

(8)

this model