GPTQ version
#3
by
tapos999
- opened
are there any plan/update yet regarding GPTQ version for this model? it still says coming soon, so wondering :)
Hi Tapos,
nah I dont think so. will update the table. There is an AWQ Version to this model linked in our space. Have you tried it?
Hi Tapos,
nah I dont think so. will update the table. There is an AWQ Version to this model linked in our space. Have you tried it?
Thanks for the update. I couldn't try unfortunately as I have V100 and currently AWQ not supported.
tapos999
changed discussion status to
closed