Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Carbon Emissions

Models

9,856

Full-text search

Active filters: 8-bit

AIFunOver/all-MiniLM-L6-v2-openvino-8bit

mlx-community/Qwen2.5-Coder-32B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 3.41k • 7

mlx-community/Qwen2.5-Coder-32B-8bit

Text Generation • Updated Nov 12, 2024 • 30 • 2

mlx-community/Qwen2.5-Coder-14B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 95 • 1

lmstudio-community/Qwen2.5-Coder-32B-Instruct-MLX-8bit

Text Generation • Updated Nov 13, 2024 • 204 • 1

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-MLX-8bit

Text Generation • Updated Nov 13, 2024 • 59 • 1

prithivMLmods/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 18, 2024 • 315 • 9

noneUsername/Qwen2.5-Coder-14B-Instruct-abliterated-W8A8-Dynamic-Per-Token

Updated Nov 14, 2024 • 41 • 1

tiiuae/Falcon3-7B-Base-1.58bit

Text Generation • Updated 18 days ago • 64 • 2

PrunaAI/distributed-optimized-gpt2-1b-bnb-8bit-smashed

Updated 28 days ago • 42 • 1

crce9598/Llama3.2-Code-Instruct-Finetune-IPAM

Text Generation • Updated Nov 15, 2024 • 3 • 1

prithivMLmods/Llama-3.2-3B-GGUF

Text Generation • Updated Nov 18, 2024 • 348 • 8

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15, 2024 • 74 • 7

mlx-community/Athene-V2-Chat-8bit

Text Generation • Updated Nov 16, 2024 • 37 • 1

bullerwins/Athene-V2-Chat-exl2_8.0bpw

Text Generation • Updated Nov 17, 2024 • 16 • 1

ArliAI/Meta-Llama-3.1-70B-Instruct_GPTQ_Q8_min

Text Generation • Updated Nov 17, 2024 • 14 • 1

kunalsuri/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Nov 18, 2024 • 24 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20, 2024 • 978k • 1

nm-testing/pixtral-12b-W8A8

Updated Nov 19, 2024 • 162 • 2

Beygo/Athene-V2-Agent-Q8-mlx

Text Generation • Updated Nov 21, 2024 • 28 • 2