An updated version of the previous model. In this one, I have not yet found any problems with word duplication.

02.05.24 Model updates, new versions are in the v1.1 branch.

Link to original model and script:

openlynn/Llama-3-Soliloquy-8B-v1.5-64k: https://huggingface.co/openlynn/Llama-3-Soliloquy-8B-v1.5-64k
FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script

Downloads last month: 19

GGUF

Model size

8.03B params

Architecture

llama

4-bit

5-bit

6-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.