-
-
-
-
-
-
Inference status
Active filters:
web-llm
mlc-ai/Qwen2.5-3B-Instruct-q4f16_1-MLC
Updated
•
108
•
2
mlc-ai/DeepSeek-R1-Distill-Qwen-1.5B-q4f16_1-MLC
Updated
•
11
•
1
mlc-ai/DeepSeek-R1-Distill-Qwen-7B-q4f16_1-MLC
Updated
•
26
•
1
mlc-ai/Llama-2-7b-chat-hf-q4f16_1-MLC
Updated
•
317
•
8
mlc-ai/Llama-2-7b-chat-hf-q4f32_1-MLC
Updated
•
308
•
2
mlc-ai/Mistral-7B-Instruct-v0.2-q4f16_1-MLC
Updated
•
1.26k
•
4
mlc-ai/Llama-2-13b-chat-hf-q4f16_1-MLC
Updated
•
277
•
1
mlc-ai/Llama-2-70b-chat-hf-q4f16_1-MLC
Updated
•
9
•
2
mlc-ai/OpenHermes-2.5-Mistral-7B-q4f16_1-MLC
Updated
•
128
•
1
mlc-ai/NeuralHermes-2.5-Mistral-7B-q4f16_1-MLC
Updated
•
146
•
2
mlc-ai/WizardMath-7B-V1.0-q4f16_1-MLC
mlc-ai/WizardMath-13B-V1.0-q4f16_1-MLC
mlc-ai/WizardMath-70B-V1.0-q4f16_1-MLC
mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f16_1-MLC
Updated
•
297
•
2
mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f32_1-MLC
Updated
•
99
•
2
mlc-ai/WizardMath-7B-V1.1-q4f16_1-MLC
Updated
•
151
mlc-ai/phi-2-q0f16-MLC
Updated
•
11
•
1
mlc-ai/phi-2-q4f16_1-MLC
Updated
•
360
•
2
mlc-ai/phi-1_5-q0f16-MLC
Updated
•
10
mlc-ai/phi-1_5-q4f16_1-MLC
Updated
•
492
mlc-ai/gpt2-q0f16-MLC
mlc-ai/gpt2-medium-q0f16-MLC
mlc-ai/Mistral-7B-Instruct-v0.2-q3f16_1-MLC
Updated
•
19
•
4
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f16_1-MLC
Updated
•
628
•
1
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f32_1-MLC
Updated
•
3.23k
•
1
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f16-MLC
Updated
•
13
mlc-ai/TinyLlama-1.1B-Chat-v0.4-q0f32-MLC
mlc-ai/phi-1_5-q0f32-MLC
mlc-ai/phi-1_5-q4f32_1-MLC
Updated
•
220
•
1
mlc-ai/phi-2-q0f32-MLC