求一个低点量化版本q4

by willber - opened 30 days ago

30 days ago

•

试用了一下，模型很不错。但是q8只能在4060ti16上跑，可以的话，希望有个q4版本，在mac上也跑一下看看。感谢作者。

Owner 16 days ago

q4啊，晚点我去量化一个，没啥问题

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment