Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

175

Full-text search

Active filters: meta-llama/Llama-3.1-8B

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_5.0bpw

Text Generation • Updated Aug 23, 2024 • 5

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_6.0bpw

Text Generation • Updated Aug 23, 2024 • 7 • 1

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_8.0bpw

Text Generation • Updated Aug 23, 2024 • 10

mradermacher/Meta-Llama-3.1-8B-GGUF

Updated 21 days ago • 111

mradermacher/Meta-Llama-3.1-8B-i1-GGUF

Updated 21 days ago • 158

chrypnotoad/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Jul 29, 2024 • 17

kaetemi/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Jul 30, 2024 • 20

vaibhavsatpathy/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Jul 30, 2024 • 11

vaibhavsatpathy/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Jul 30, 2024 • 2

neuralmagic/Meta-Llama-3.1-8B-FP8

Text Generation • Updated Oct 9, 2024 • 10.6k • 5

kaetemi/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Jul 31, 2024 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 272 • 1

polyverse/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 1, 2024 • 2

mariagrandury/Meta-Llama-3.1-8B-ft-LoRA-elgrancorpus-it-gguf-q4_k_m

Text Generation • Updated Aug 2, 2024 • 29

swilde42/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 1, 2024 • 1

reach-vb/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Aug 1, 2024

reach-vb/Meta-Llama-3.1-8B-Q2_K-GGUF

Text Generation • Updated Aug 1, 2024 • 3 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12

Text Generation • Updated Aug 1, 2024 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o14

Text Generation • Updated Aug 1, 2024 • 4

sgerhart/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 2, 2024 • 1 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-4lc

Text Generation • Updated Aug 3, 2024

polyverse/Meta-Llama-3.1-8B-Q5_K_M-GGUF

Text Generation • Updated Aug 3, 2024 • 1

5fp/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 4, 2024

5fp/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Aug 4, 2024 • 9

fedric95/Meta-Llama-3.1-8B-GGUF

Text Generation • Updated Oct 21, 2024 • 205 • 1

FriendliAI/Meta-Llama-3.1-8B-Instruct-fp8

Text Generation • Updated Nov 3, 2024 • 21

QuantFactory/dolphin-2.9.4-llama3.1-8b-GGUF

Updated Aug 6, 2024 • 131 • 2

mlc-ai/Llama-3.1-8B-q4f32_1-MLC

Updated Sep 19, 2024 • 15

mlc-ai/Llama-3.1-8B-q4f16_1-MLC

Updated Sep 19, 2024 • 2

mlc-ai/Llama-3.1-8B-q0f16-MLC

Updated Sep 19, 2024