-
-
-
-
-
-
Inference status
Active filters:
web-llm
mlc-ai/CodeLlama-13b-Python-hf-q4f32_1-MLC
mlc-ai/CodeLlama-34b-Python-hf-q4f16_1-MLC
mlc-ai/CodeLlama-34b-Python-hf-q4f32_1-MLC
mlc-ai/CodeLlama-70b-hf-q3f16_1-MLC
mlc-ai/CodeLlama-70b-hf-q4f16_1-MLC
Updated
•
15
mlc-ai/CodeLlama-70b-hf-q4f32_1-MLC
mlc-ai/CodeLlama-70b-Instruct-hf-q3f16_1-MLC
mlc-ai/CodeLlama-70b-Instruct-hf-q4f16_1-MLC
Updated
•
11
mlc-ai/CodeLlama-70b-Instruct-hf-q4f32_1-MLC
Updated
•
13
mlc-ai/CodeLlama-70b-Python-hf-q4f32_1-MLC
Updated
•
4
•
1
mlc-ai/CodeLlama-70b-Python-hf-q3f16_1-MLC
Updated
•
11
•
1
mlc-ai/CodeLlama-70b-Python-hf-q4f16_1-MLC
Updated
•
6
•
1
mlc-ai/stablelm-2-zephyr-1_6b-q0f16_1-MLC
Updated
mlc-ai/stablelm-zephyr-3b-q0f16-MLC
mlc-ai/stablelm-zephyr-3b-q0f32-MLC
mlc-ai/stablelm-zephyr-3b-q4f16_1-MLC
mlc-ai/stablelm-zephyr-3b-q4f32_1-MLC
Updated
•
4
•
1
mlc-ai/gemma-2b-it-q4f16_1-MLC
Updated
•
509
•
5
mlc-ai/gemma-2b-it-q4f32_1-MLC
Updated
•
120
•
2
mlc-ai/gemma-2b-it-q0f16-MLC
mlc-ai/gemma-2b-it-q0f32-MLC
mlc-ai/gemma-7b-it-q0f16-MLC
mlc-ai/gemma-7b-it-q4f16_2-MLC
Updated
•
16
•
1
mlc-ai/gorilla-openfunctions-v1-q4f16_1-MLC
mlc-ai/gorilla-openfunctions-v2-q4f16_1-MLC
Updated
•
4
•
2
mlc-ai/gorilla-openfunctions-v2-q4f32_1-MLC
mlc-ai/gemma-2b-it-q4f16_0-MLC
mlc-ai/Qwen1.5-MoE-A2.7B-Chat-q4f16_1-MLC
Updated
•
4
•
3
mlc-ai/Llama-3-8B-Instruct-q0f32-MLC
mlc-ai/Llama-3-70B-Instruct-q3f16_1-MLC
Updated
•
131
•
1