Nexesenex
/

Meta-Llama-3.1-70b-instruct-bf16-iMat-CQ-GGUF

Inference Endpoints

Model card Files Files and versions Community

IQ5_K quant requires IK_Llama.CPP or Croco.Cpp to run.

Downloads last month: 47

GGUF

Model size

70.6B params

Architecture

llama

4-bit

5-bit

16-bit

Inference API

Unable to determine this model's library. Check the docs .