File size: 620 Bytes
aa82dfa 8c05361 aa82dfa 8c05361 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
license: apache-2.0
language:
- en
- de
- es
- fr
- it
- pt
- pl
- nl
- tr
- sv
- cs
- el
- hu
- ro
- fi
- uk
- sl
- sk
- da
- lt
- lv
- et
- bg
- 'no'
- ca
- hr
- ga
- mt
- gl
- zh
- ru
- ko
- ja
- ar
- hi
base_model: NousResearch/Hermes-3-Llama-3.1-8B
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation
---
4-bit [GPTQ](https://arxiv.org/abs/2210.17323) quantized version of [utter-project/EuroLLM-9B-Instruct](https://huggingface.co/utter-project/EuroLLM-9B-Instruct) for inference with the [Private LLM](https://privatellm.app/) app.
|