LM Studio Settings:

Before System: <|im_start|>system\n
After System: <|im_end|>\n
Before User: <|im_start|>user\n
After User: <|im_end|>\n
Before Assistant: <|im_start|>assistant\n
After Assistant: <|im_end|>\n

Downloads last month: 30

GGUF

Model size

7.62B params

Architecture

qwen2

4-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for pipilok/Qwen2.5-Coder-7B-Instruct-Q4_0_4_8-GGUF

Base model

Qwen/Qwen2.5-7B

Finetuned

Qwen/Qwen2.5-Coder-7B

Quantized

(30)

this model