Memory Usage
#1
by
gregoryS
- opened
Hello, thank you for the quantization.
Weirdly I'm facing error: Insufficient Memory (00000008:kIOGPUCommandBufferCallbackErrorOutOfMemory) on my M3pro with 64G of shared RAM ( on which I can run 16B version of llama3.1-7b) even with the NuExtract-v1.5-Q4_K_M.gguf model . Have you face the same problems ?