can the medium model run on CPU
#5
by
ctranslate2-4you
- opened
I can get the large model to run on the cup but just not the medium for some reason. My best guess is that it's because of the different architectures between the models and the medium's reliance on xformers? To be clear, both models run perfectly fine using "cuda" and the large works using "cpu," it's just the medium I can't get to work on the "cpu."
Anyways, here's the error I get just for the medium model:
