radi-cho
/

gemma-2-9b-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

gemma-2-9b-AWQ / model.safetensors.index.json

Commit History

Add Gemma2 quantized with AWQ.

456583f

radi-cho commited on Aug 1, 2024