Hardware requirements?

#19
by JohnnieB - opened

Hey guys, what hardware's required to run this model as is?

@JohnnieB what do you mean by this? I was able to run this locally on a 3080

vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager

image.png

but also primeintellect has really cheap hardware

I meant what hardware does the full Deepseek-R1 need to run, not the Distilled versions. It's good to know Distill-Qwen-32B can run locally on a 3080 tho.

Sign up or log in to comment