EXL2 quants of [Llama-3 70B](https://huggingface.co/NousResearch/Meta-Llama-3-70B)

More versions coming soon.

[5.00 bits per weight](https://huggingface.co/turboderp/Llama-3-70B-exl2/tree/5.0bpw)     

[measurement.json](https://huggingface.co/turboderp/Llama-3-70B-exl2/blob/main/measurement.json)