Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

11

Full-text search

Active filters: 4.0bpw

llmixer/BigWeave-v6-90b-4.0bpw-h8-exl2

Text Generation • Updated Jan 22, 2024 • 6

llmixer/BigWeave-v8-90b-4.0bpw-h8-exl2

Text Generation • Updated Jan 23, 2024 • 6

llmixer/BigWeave-v9-90b-4.0bpw-h8-exl2

Text Generation • Updated Jan 23, 2024 • 6

llmixer/BigWeave-v12-90b-4.0bpw-h8-exl2

Text Generation • Updated Jan 27, 2024 • 6

llmixer/BigWeave-v16-103b-4.0bpw-h6-exl2

Text Generation • Updated Feb 10, 2024 • 6

llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2

Text Generation • Updated Feb 10, 2024 • 8 • 1

llmixer/BigWeave-v18-108b-4.0bpw-h6-exl2

Text Generation • Updated Feb 15, 2024 • 6

llmixer/BigWeave-v20-110b-4.0bpw-h6-exl2

Text Generation • Updated Feb 15, 2024 • 6

llmixer/Midnight-Rose-103B-v2.0.3-4.0bpw-h6-exl2

Text Generation • Updated Feb 16, 2024 • 5

llmixer/BigWeave-v7.1-124b-4.0bpw-h6-exl2

Text Generation • Updated Feb 20, 2024 • 8

TheVisitorX/InfinityRP-v1-7B-4.0bpw-exl2

Text Generation • Updated Apr 1, 2024 • 3