Edit Models filters

Model Tree

SweatyCrayfish/llama-3-8b-quantized

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

3

Full-text search

Active filters: SweatyCrayfish/llama-3-8b-quantized

PrunaAI/SweatyCrayfish-llama-3-8b-quantized-HQQ-1bit-smashed

Text Generation • Updated Jul 19, 2024 • 5

PrunaAI/SweatyCrayfish-llama-3-8b-quantized-HQQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 5

PrunaAI/SweatyCrayfish-llama-3-8b-quantized-HQQ-2bit-smashed

Text Generation • Updated Jul 19, 2024 • 5