numen-tech's picture
Add weights
5a6be40
metadata
language:
  - en
license: llama3.1
base_model: FuseAI/FuseChat-Llama-3.1-8B-Instruct
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

3-bit OmniQuant quantized version of FuseChat-Llama-3.1-8B-Instruct for inference with the Private LLM app.