Quantized Model in GGML of: https://huggingface.co/zarakiquemparte/hermeslimarp-l2-7b
If you need other quantized models use @TheBloke:
Quantized Model in GGML of: https://huggingface.co/zarakiquemparte/hermeslimarp-l2-7b
If you need other quantized models use @TheBloke: